-- Logs begin at Tue 2022-09-13 11:31:28 UTC, end at Tue 2022-09-13 12:33:08 UTC. -- Sep 13 12:00:55.698441 dv-osbrick-857347-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 12:00:55.707989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 12:00:55 2022] *** Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: nodename: dv-osbrick-857347-1-iscsi Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: machine: x86_64 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: clock source: unix Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: pcre jit disabled Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: detected number of CPU cores: 4 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: current working directory: / Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: detected binary path: /usr/bin/uwsgi-core Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: your processes number limit is 47680 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: your memory page size is 4096 bytes Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: detected max file descriptor number: 2048 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: lock engine: pthread robust mutexes Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: thunder lock: enabled Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 12:00:55.720501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 12:00:55.752364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: Python main interpreter initialized at 0x558cc00c99c0 Sep 13 12:00:55.752364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: python threads support enabled Sep 13 12:00:55.752364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: your server socket listen backlog is limited to 100 connections Sep 13 12:00:55.752364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: your mercy for graceful operations on workers is 90 seconds Sep 13 12:00:55.752843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 12:00:55.752843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: *** Operational MODE: preforking *** Sep 13 12:00:55.753148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: *** uWSGI is running in multiple interpreter mode *** Sep 13 12:00:55.753148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: spawned uWSGI master process (pid: 81563) Sep 13 12:00:55.753355 dv-osbrick-857347-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 13 12:00:55.755362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: spawned uWSGI worker 1 (pid: 81576, cores: 1) Sep 13 12:00:55.755362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: spawned uWSGI worker 2 (pid: 81577, cores: 1) Sep 13 12:00:55.756198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81563]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 12:01:00.153281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:01:00.153281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: from cryptography.utils import int_from_bytes Sep 13 12:01:00.154447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:01:00.154447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: from cryptography.utils import int_from_bytes Sep 13 12:01:00.156507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:01:00.156507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Sep 13 12:01:00.156507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:01:00.156507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Sep 13 12:01:00.204838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:01:00.205047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:01:00.205347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] command line args: [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:01:00.205500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:01:00.205711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ================================================================================ {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:01:00.205938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] admin_token = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.206159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] config_dir = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.206299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.206483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] config_source = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.206657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] debug = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.206854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:01:00.209883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_config_append = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.209991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:01:00.210109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] command line args: [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:01:00.210339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_dir = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_file = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:01:00.210461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ================================================================================ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:01:00.210569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_dir = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.210956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_source = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] debug = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.211662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.213117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.213479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.213829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.214171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.214495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.214822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.215027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.215311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.215597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.215829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.216148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_config_append = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.216148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.216565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.216772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_dir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.217023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.217346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.217644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.217855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.217855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.218262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.218466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.218628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] publish_errors = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.218763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.218931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.219873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.220109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.220304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.220492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] standard_threads = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.220695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.220876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] use_journal = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.221927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] use_json = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] use_stderr = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] use_syslog = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.222821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.223085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.223280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.223497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] publish_errors = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.223497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.223736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.223860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.224028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.224193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.224325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.224450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.224574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.224698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.224866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.225069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] standard_threads = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.225276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.225431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.225633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.225776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.225903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.226053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.226223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.226352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_journal = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.226352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_json = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.226586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.226716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_stderr = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.226850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.226975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_syslog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.227098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.227221 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:01:00.227344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.228931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.229908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.230845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.231105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.231273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.231455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.231660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.231868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.232232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.232454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.232733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.232937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.233117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.233264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.233458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.233676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.233875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.234981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.235117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.235311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.235515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.235515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.235843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.236980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.237870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.238000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.238164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.238299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.238774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.238976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.239125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.239327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.239535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.239749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.240864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.241825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.243942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.244479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.244695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.244921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.245197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.245521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.245771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.246104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.246348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.246576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.246808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.247017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.247180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.247367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.247367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.247845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.248082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.248272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.248459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.248691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.248857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.249045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.249262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.249492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.249863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.250953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.251931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.252198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.252394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.252551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.252753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.252959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.253160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.253363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.253546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.253676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.253858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.254997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.255263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.255399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.255555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.255750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.255986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.256208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.256429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.256603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.256812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.256973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.257900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.258946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.259933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.260926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.261840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.external = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.262939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.263941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.password = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] auth.token = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.264990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.265913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.266865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.267909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.external = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.268958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.password = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.269929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.token = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.270994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.271194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.271331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.271497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.271668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.271872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.272122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.272327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.272536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.272752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.272917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.273844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.274055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.274224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.274898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.275851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.276888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.277941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.278997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.279905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.280865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.281993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.282981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.283944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.284172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.284375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.284599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.284803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.284985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.285865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.286906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.287946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.288948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.289259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.289387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.289539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.289672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.289799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.290578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.290821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.291027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.291235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.291436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.291767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.292973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.293973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.294195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.294400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.294613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.294821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.294990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.295806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.296959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.297946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.298953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.299152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.299327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.299458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.299621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.299812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.300827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.301001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.301213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.301420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.301620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.301829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.302922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.303128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.303288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.303491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.303685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.303860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.304140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.304389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.304620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.304794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.304925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.305107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.305281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.305425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.305656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.305932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.306138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.306276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.306481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.306686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.306883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.307989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.308183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.308382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.308576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.308777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.308947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] role.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.309876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] role.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.310998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.311154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.311289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.311583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.311793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.311933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.312959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.313903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.314857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.315871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.316186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.316419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.316641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.316875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.317092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.317305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.317524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.317760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.317988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.318210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.318423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.318638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.318857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.319086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.319306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.319525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.319757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.320010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.320234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.320480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.320699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.320923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.321175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.321401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.321607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.321777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.321991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.322203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.322203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.322620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.322783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.322955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.323101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.323236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.323408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.323625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.323857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.324141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.324287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.324544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.324737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.324737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.325927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.326870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.327094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.327275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.327493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.327731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.327951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.328215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.328458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.328742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.328978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.329193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.329404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.329625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.connection = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.329842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.330054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.330287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.330505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.330746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.330965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.331180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.331404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.331631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.331847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.332159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.332376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.332597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.332834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.333053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.333277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.333501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.333721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.333957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.334194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.334414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.334697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.334923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.335155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.335379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.335613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.335829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.336066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.336291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.336514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.336514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.337489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.337728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.337950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.338838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.340756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.342683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.342683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.342683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:01:00.342683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:01:00.343561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.343561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.343561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.344420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.344420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.344420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.345176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.345316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.360639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.360947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.361120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.361120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.418120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.418649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.469873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.470142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.470647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.470886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.653940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.654974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.655067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.655324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.655461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.655657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.655799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.694327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.694545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.694669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.694964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.695175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.695390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.695597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.696157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.697196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.697578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.697962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.698339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.698718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.699089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.708718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.719492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.722398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.722685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.722913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.723137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.723393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.723393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.723841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.724113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.724113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.724542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.724542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.724542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.725183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.725183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:01:00.741952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.742434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:01:00.742653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.742880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:01:00.743091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.743461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.743800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.744133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.744569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.744795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:01:00.745105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.745324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:01:00.745553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.745817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.746079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.746337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.754533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.754812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.755092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.755379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.755989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.756292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.756566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.756932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.763239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.764607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.766431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.766721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.767066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.767364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.767594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.767812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.768069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.768291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.768531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.768728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.768930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.769928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.770140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.770481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.770481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.770481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.770481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.793237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.793644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.794754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.795042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.795269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.795493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.799853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.800225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.800450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.800668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.800907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.801126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.807652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.807944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.808129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.808342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.811924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.812238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.812528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.814515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.814731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.814974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.815814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.816010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.816225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.816225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.816516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.831567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.832040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.832306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.832540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.835788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.836321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.839489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.839909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.840185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.840477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.844166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.844733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.847324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.847854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.850476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.850785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.851078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.851344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.851577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.851830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.852176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.852409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.853228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.853465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.853696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.853696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.868837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.869291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.869532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.869805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.870035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.870268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.870514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.870514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.876576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.877168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.878264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.878706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.879797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.880102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.880261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.880521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.882786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.883053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.883296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.883526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.883758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.884020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.884270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.884515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.884793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.884793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.895387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.895715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.895871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.896068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.896937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.897092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.897229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.897375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.897613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.913242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.914067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.916955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.917644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.919871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.920587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.921390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.922100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.922864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.923147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.923433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.923669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.923900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.924311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.930052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.930814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.931566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.932338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.934486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.934781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.935068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.935235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.935380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.935658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.935944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.943348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.943646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.943930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.944132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.944472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.944711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.951019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.951357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.951582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.951729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:01:00.952023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.952230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.952426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.952625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.952848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.953065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.953254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.953463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.953668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.953926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.954123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.954324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.954520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.954716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.954952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.955148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.955343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.955536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.955730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.955941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.956158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.956352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.956352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.956352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:01:00.990004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cc00c99c0 pid: 81577 (default app) Sep 13 12:01:00.991138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cc00c99c0 pid: 81576 (default app) Sep 13 12:01:00.993707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf01088-392d-41e5-b316-11c8cd9f4f4a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:00.993992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf01088-392d-41e5-b316-11c8cd9f4f4a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:00.994265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf01088-392d-41e5-b316-11c8cd9f4f4a None None] PATH_INFO: `/v3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:00.998469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Sep 13 12:01:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:08.364475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:08.365047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:08.365047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:08.370080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:08.375764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:08.376443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:08.376443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:08.449042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: INFO dbcounter [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] Registered counter for database keystone Sep 13 12:01:08.468637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG oslo_db.sqlalchemy.engines [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:01:08.475465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writer thread running {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:01:08.679226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81577) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:01:08.679610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81577) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:01:08.739389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:08.741227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:08.874916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 12:01:09.341372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:09.413560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: INFO dbcounter [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] Registered counter for database keystone Sep 13 12:01:09.436041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG oslo_db.sqlalchemy.engines [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:01:09.442747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writer thread running {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:01:09.574337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec823-3ef0-44ca-ac15-53b8eed3feb5 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:09.578875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:09.579508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:09.579788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:09.580088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:09.589639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:09.642230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING keystone.common.rbac_enforcer.enforcer [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:01:09.642567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c20e5-8b1b-40e6-ba7b-c47320678a2d admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:09.653735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Sep 13 12:01:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:01:09.660209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:09.678346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1b096-c513-46c1-90de-7f1789653e63 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:09.683356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:09.684554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:09.684839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:09.685129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] PATH_INFO: `/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:09.687019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb5edf9a0e494edcae6ef0e92c3e80ed)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:09.740983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:01:09.741327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a41b-b1b9-494f-a513-0d8fcbae7c85 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:09.746175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Sep 13 12:01:09 2022] GET /identity/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:11.983329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beb39-f350-4f56-aafc-439fa78af300 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:11.984058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beb39-f350-4f56-aafc-439fa78af300 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:11.984058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beb39-f350-4f56-aafc-439fa78af300 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:11.988069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:11.994584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:11.995133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:11.995949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:12.016923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:12.018504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:12.029610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 12:01:12.300803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225beb39-f350-4f56-aafc-439fa78af300 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:12.313172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225beb39-f350-4f56-aafc-439fa78af300 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:12.317625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:12.318243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:12.318518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:12.318788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:12.327687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:12.329696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d0cf-e990-4490-b50d-2ee840ff4c14 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:12.340354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Sep 13 12:01:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 12:01:12.346715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:12.357018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba13c-8097-4ba9-ad16-26d4db5b9f4c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:12.361825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:12.362477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:12.362757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:12.363031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:12.364478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:12.366607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e37b7-cc5c-43e5-8b26-c8dda318a087 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:12.368279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Sep 13 12:01:12 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:14.686127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339b29-20b4-49dc-b99e-b573dd83377e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:14.686825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339b29-20b4-49dc-b99e-b573dd83377e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:14.686825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339b29-20b4-49dc-b99e-b573dd83377e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:14.688042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:14.693706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:14.694200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:14.694303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:14.713427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:14.715193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:14.721330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d870-7df5-4cc6-9c77-aafcf915e414 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:14.721636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d870-7df5-4cc6-9c77-aafcf915e414 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:14.721916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d870-7df5-4cc6-9c77-aafcf915e414 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:14.723363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:14.729096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:14.729378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:14.729658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:14.779705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG passlib.handlers.bcrypt [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81576) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:01:14.780129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG passlib.handlers.bcrypt [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81576) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:01:14.807298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:14.830158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:14.831799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:14.947251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:15.079550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.107046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.195782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613e5d-b26d-4c9e-961c-c8857a664494 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.223154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.232591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.233237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.233517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.233793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.246022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:15.254990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:15.255920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:15.256798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:15.262335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.335075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643966b2-3322-4172-bf94-5dfc449ef95a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.337498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.350046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.379030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.379288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e64ad-0c8d-449b-b4a1-e3ef995eacfb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.379916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.380224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.380494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.417107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.417741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.418029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.418305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.418984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:15.419288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.420713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.433118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:15.438919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.453098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.454864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.557359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b5f99-540e-440f-8087-614c00ce2305 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.563786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:01:15.569443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.572407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.594886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.595517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.595795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.596097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.597242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.598692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.600292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:15.607207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.625469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.681844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dfe5d-fadd-4cb7-afb8-523432761377 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.720123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.721031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.721317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.721583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.726544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfd90-741f-4842-ae13-e63701092842 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.742517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.744060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:01:15.765336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:15.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:01:15.767306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:01:15.767306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:01:15.767306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:15.768976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:01:15.769266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.769961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.770244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.770515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.771800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.773315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.774982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:15.775642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.782229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:15.837020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.885149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1fb2f-d887-4b06-be32-4f02453fae94 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.886359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:15.917232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528f0f-40ed-480e-b3da-3cbee720f609 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:15.923129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.923745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.924054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.924327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.924983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:15.925284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.926673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ea5a1-3fd5-4078-b726-eeaf1a5d1aaf None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.945786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:15.958809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:15.959444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:15.959727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:15.960032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:15.960798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.domain.id=default, user.id=25e6c04dcaa6467c806fd0a095469485) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:15.961105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:15.962613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea6a70-deb8-438e-9d3b-5546af2e3053 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:15.970450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Sep 13 12:01:15 2022] GET /identity/v3/role_assignments?user.id=25e6c04dcaa6467c806fd0a095469485&scope.domain.id=default&role.id=83fb245122344892b0377532854af000 => generated 233 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:18.574346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d090b0-5666-4d4f-9ea1-cc26a8c50539 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:18.575781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d090b0-5666-4d4f-9ea1-cc26a8c50539 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:18.576340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d090b0-5666-4d4f-9ea1-cc26a8c50539 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:18.577968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:18.584022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda617e-87bf-45a0-83ba-bef72e9f4f25 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:18.584997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda617e-87bf-45a0-83ba-bef72e9f4f25 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:18.585510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda617e-87bf-45a0-83ba-bef72e9f4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:18.613079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3fda617e-87bf-45a0-83ba-bef72e9f4f25 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:18.614672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3fda617e-87bf-45a0-83ba-bef72e9f4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:18.713039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:19.229739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcbeb-3ff1-4434-87ec-940f6b5fc293 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.230350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcbeb-3ff1-4434-87ec-940f6b5fc293 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.230832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcbeb-3ff1-4434-87ec-940f6b5fc293 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.232941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:19.242959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03df31-c9e3-45b6-870d-0441f807b92f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.243537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03df31-c9e3-45b6-870d-0441f807b92f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.244041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03df31-c9e3-45b6-870d-0441f807b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.266417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ab03df31-c9e3-45b6-870d-0441f807b92f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:19.267989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ab03df31-c9e3-45b6-870d-0441f807b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:19.277114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcbeb-3ff1-4434-87ec-940f6b5fc293 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:19.446035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:19.476489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcbeb-3ff1-4434-87ec-940f6b5fc293 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:19.498665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918af-8c0b-429b-b962-af1ffb800e4d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.499329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918af-8c0b-429b-b962-af1ffb800e4d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.499790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918af-8c0b-429b-b962-af1ffb800e4d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.501375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:19.506882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465aad-139b-407c-9208-678440c9a977 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.507489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465aad-139b-407c-9208-678440c9a977 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.507952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465aad-139b-407c-9208-678440c9a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.508367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:19.532528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:19.549053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-aa465aad-139b-407c-9208-678440c9a977 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:19.550675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aa465aad-139b-407c-9208-678440c9a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:19.562173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:19.562831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.563109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.563378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.596976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:19.603597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:19.604443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:19.605193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 13/27] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:19.613425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:19.732718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:19.783876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01ab5-5761-4c6c-933d-0f11d63c284e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.784541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01ab5-5761-4c6c-933d-0f11d63c284e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.785000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01ab5-5761-4c6c-933d-0f11d63c284e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.786520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 16/29] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:19.792472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.792997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.793544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.826959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:19.834751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:19.840642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bdbce-98ec-4777-9bae-6a479cc5130b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:19.888663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:19.890398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:19.891073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:19.892710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:19.893631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:19.894998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:19.896633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:19.925441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 14/30] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:19.926620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:19.970107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:19.971407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.028978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:20.114736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:20.153980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96a36-68b6-4109-9a31-1b3adf93f85e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.198575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.199789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.200369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.200917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.214164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.216271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.221721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4b37-b0e0-4d10-b742-e26a609ce77e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:01:20.234688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:20.235655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:01:20.236565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:01:20.236565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:01:20.236565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:20.238753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 15/32] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:20.239864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.332766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.333431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.333963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.333963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.335207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.336736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.338408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 18/33] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:19 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:20.340380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.351434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:20.365220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13cbfc-5a20-44e1-b925-ea36f139f3ca None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.411212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.412865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.413160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.413434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.414147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.415558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.543445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd16aaf-a4a2-40d0-b796-b319c6b99cb1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.560822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 16/34] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 12:01:20 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:20.561860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.598695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:20.608022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.609324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.609645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.609922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.610931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:20.611261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.613632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.650600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 19/35] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:20.652066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.736903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386731-8a65-4b63-8aa3-72425f5b8d5d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.786550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.787319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.787598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.787922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.789740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.791449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdca9d-0dd3-4648-b42d-58d26151c06b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.793247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 17/36] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:20.794690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc678-edd3-4c00-a10b-5fba10f86f5d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.794968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc678-edd3-4c00-a10b-5fba10f86f5d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.795239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc678-edd3-4c00-a10b-5fba10f86f5d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.796663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 18/37] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:20.797449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc678-edd3-4c00-a10b-5fba10f86f5d None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:20.803241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cc639-b34e-4a95-94b6-e9a3b1ab2663 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.824803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:20.851826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.852400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.852678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.852953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.853840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.856729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49c5e-538e-481f-939f-20050134cad5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:20.938702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc678-edd3-4c00-a10b-5fba10f86f5d None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:20.975729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:20.976491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:20.976697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:20.976962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:20.977625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:20.979104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:21.009707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 19/38] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:01:20 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:21.010817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:21.084854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 12:01:20 2022] POST /identity/v3/roles => generated 225 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:21.084854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6ee80-84e4-4404-8993-e4f26fd97dec None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.084854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6ee80-84e4-4404-8993-e4f26fd97dec None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.084854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6ee80-84e4-4404-8993-e4f26fd97dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.117559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:21.120315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6db6ee80-84e4-4404-8993-e4f26fd97dec None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:21.122928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6db6ee80-84e4-4404-8993-e4f26fd97dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:21.194268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15e0f-63ac-4c63-80ac-6c0a95b38fbb None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:21.207812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:21.241800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:21.246352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94d47-e521-4543-917d-7689e3a03c5f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.247258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94d47-e521-4543-917d-7689e3a03c5f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.247989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94d47-e521-4543-917d-7689e3a03c5f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.260513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 22/41] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:21 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:21.267088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.268117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.268865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.306372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:21.307082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.307366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.307646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] PATH_INFO: `/v3/domains/default/users/25e6c04dcaa6467c806fd0a095469485/roles/83fb245122344892b0377532854af000` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.314102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=25e6c04dcaa6467c806fd0a095469485, role_id=83fb245122344892b0377532854af000)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:21.315625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:21.340121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Sep 13 12:01:21 2022] PUT /identity/v3/domains/default/users/25e6c04dcaa6467c806fd0a095469485/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:21.430234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:21.431421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:21.522796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 23/43] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:21.554063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:21.673582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cdb9d-3412-474e-937d-f83e357adf23 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:21.706227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:21.714563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:21.715262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.715621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.716626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.717672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:21.718990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:21.720812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 21/44] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:21.726473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:21.796814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:21.868084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d65b8-fa42-461f-9e85-5bded05f9831 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:21.886206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:21.917670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34514130-82ad-4947-8196-f305e059689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:21.918309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514130-82ad-4947-8196-f305e059689a None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:21.918646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514130-82ad-4947-8196-f305e059689a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:21.918956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514130-82ad-4947-8196-f305e059689a None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:21.919649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34514130-82ad-4947-8196-f305e059689a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:21.921388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34514130-82ad-4947-8196-f305e059689a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:21.955175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f2bb-5261-470b-bf8c-fddabeab212f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:21.968086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 24/45] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:01:21 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:22.012821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:22.013949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:22.014226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:22.014493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:22.015192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:22.016680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d0056-0977-42cf-afdd-51e451868529 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:22.033385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 12:01:21 2022] POST /identity/v3/roles => generated 223 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:01:23.636059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722aaeb-b614-447d-8ee6-aa51bf3bfb94 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:23.636574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722aaeb-b614-447d-8ee6-aa51bf3bfb94 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:23.636657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722aaeb-b614-447d-8ee6-aa51bf3bfb94 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:23.638809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:23.647111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:23.647619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:23.647703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:23.667988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:23.670057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:23.740981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:23.758097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:24.025287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722aaeb-b614-447d-8ee6-aa51bf3bfb94 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.140163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722aaeb-b614-447d-8ee6-aa51bf3bfb94 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.183691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.184364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.184645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.185650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.200372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-546cbe40-b71e-4596-86d5-765ded4c87fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:24.205398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:24.206312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:24.207093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 26/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:24.215222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.226692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5051d-a4e1-4c14-bf1e-2c6e101cd3ab None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.226993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5051d-a4e1-4c14-bf1e-2c6e101cd3ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.227240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5051d-a4e1-4c14-bf1e-2c6e101cd3ab None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.228681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 27/50] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:24.237574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.237857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.238133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.258664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:24.259877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:24.279740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:24.329820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b3c0-6cc8-40e4-ae6c-4ae712dfcf80 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.333346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 28/51] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:24.370195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.370812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.371081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.371354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.372056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:24.372356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:24.373772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:24.383135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:24.389681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.508361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a375a-a6dd-47d0-93b6-88eb7f3074b5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.551492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.552423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.552834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.553222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.554915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:24.557345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:24.566077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 29/53] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:24.567372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.617495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.623234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:24.646964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:24.689043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badf0b-8ec6-4ef1-a434-1bad0931e026 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.725717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.726540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.726817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.727086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.728265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:24.729725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:24.731330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 25/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:24.739512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.746329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762e0b-32c3-49ac-8a2a-4911c8016f46 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.783155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.783795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.784121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.784399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.785559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:24.787021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:24.788725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:24.795046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:24.910345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:24.923055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41552501-7a7c-4739-950d-378212b9e645 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:24.969967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:24.970651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:24.970934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:24.971220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:24.971933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:24.973434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d2a9-eae7-4fdf-91fc-10e44372ce03 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:24.982176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8db4-db37-473c-b688-b3ef2cdb7384 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:25.003600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:25.004133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 31/56] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Sep 13 12:01:24 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:01:25.033371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:25.034354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:25.034820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:25.035241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:25.036547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.domain.id=default, user.id=25e6c04dcaa6467c806fd0a095469485) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:25.037052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:25.039563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06edc1-629e-4ece-b16b-dc85bcf0463b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:25.068007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 26/57] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Sep 13 12:01:24 2022] GET /identity/v3/role_assignments?user.id=25e6c04dcaa6467c806fd0a095469485&scope.domain.id=default&role.id=83fb245122344892b0377532854af000 => generated 530 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:27.269005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c378d-9cde-4d9c-9c36-2309fd4ce7a5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:27.269531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c378d-9cde-4d9c-9c36-2309fd4ce7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:27.269531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c378d-9cde-4d9c-9c36-2309fd4ce7a5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:27.270912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 32/58] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:27.276771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:27.277255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:27.277359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:27.302933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:27.304204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:27.378132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:27.664300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c378d-9cde-4d9c-9c36-2309fd4ce7a5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:27.769458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c378d-9cde-4d9c-9c36-2309fd4ce7a5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:27.806365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:27.807003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:27.807280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:27.807553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:27.808706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:27.810149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da345-8870-4fac-bd5c-a89c9bf4198c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:27.811726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 33/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:27.817969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:27.921370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f576a-fff0-46f1-9fc5-3269f154c937 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:27.934944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:27.955953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:27.956594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:27.956876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:27.957152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:27.957812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:27.959251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec7266-c994-40c5-83e4-4111cd006c10 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:27.987079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 28/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:01:27 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:31.529283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35414-cdc2-4846-8f1f-85fa5e80e017 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.530873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35414-cdc2-4846-8f1f-85fa5e80e017 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.531361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35414-cdc2-4846-8f1f-85fa5e80e017 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.533010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 34/62] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:31.541878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f953c-8e68-4625-a6bf-aaad7629f023 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.542829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f953c-8e68-4625-a6bf-aaad7629f023 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.543304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f953c-8e68-4625-a6bf-aaad7629f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.572947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-576f953c-8e68-4625-a6bf-aaad7629f023 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:31.574571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-576f953c-8e68-4625-a6bf-aaad7629f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:31.691776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 29/63] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:31.744011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4d44-dc1c-4658-8bef-980be4016ebe None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.744011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4d44-dc1c-4658-8bef-980be4016ebe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.744011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4d44-dc1c-4658-8bef-980be4016ebe None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.745036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 35/64] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:31.751327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.751948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.752471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.778540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:31.780146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:31.880987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c756-45cb-4e93-ad56-d38707231856 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.881978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c756-45cb-4e93-ad56-d38707231856 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.882750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c756-45cb-4e93-ad56-d38707231856 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.885658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 36/65] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:31.892265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193cf3a-f212-45f3-9b49-1ddbb8398883 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:31.892855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193cf3a-f212-45f3-9b49-1ddbb8398883 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:31.893350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193cf3a-f212-45f3-9b49-1ddbb8398883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:31.906024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 30/66] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:31.932389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5193cf3a-f212-45f3-9b49-1ddbb8398883 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:31.934266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5193cf3a-f212-45f3-9b49-1ddbb8398883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:31.940547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.076136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 37/67] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:32.079417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.131118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.243656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b115a1-a6ab-42ef-925a-4ef14f3e2a7e None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.245377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddeeb-0be2-403b-a0b5-2923fbb78e0f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.246226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddeeb-0be2-403b-a0b5-2923fbb78e0f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.246708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddeeb-0be2-403b-a0b5-2923fbb78e0f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.248681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 38/68] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:32.260240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.261726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.263209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.305645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:32.308405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:32.330277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.331506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.332045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.332902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.349711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:32.354687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:32.355642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:32.356551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 31/69] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:01:32.357225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.423208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 39/70] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:32.428955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.488598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.508154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1044f7-614f-412d-a88a-de08ba91b377 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.539035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.562559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.564776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.565371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.565888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.579452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1351d0b-e40c-42c5-b205-a9bc9823d830 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.588765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:32.599934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:32.601662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:32.603234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 32/71] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:32.604299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.619421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.620139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.620425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.620966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.621742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:32.622583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:32.624603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a756d00-2830-4e32-ad08-754dff7a8b5f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 40/72] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc251e-8df9-49e6-9dcd-35c4effd4dcc None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc251e-8df9-49e6-9dcd-35c4effd4dcc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc251e-8df9-49e6-9dcd-35c4effd4dcc None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 41/73] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:32.639001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc251e-8df9-49e6-9dcd-35c4effd4dcc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.756531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e2ad-6336-4b02-aab0-ea8b7ebccb33 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.792495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc251e-8df9-49e6-9dcd-35c4effd4dcc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.798070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.798724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.799002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.799272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.810538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:32.817247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:32.818335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 33/74] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:32.819386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:32.831839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.837424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:32.844881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.845433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.845718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.845992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.846676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:32.846978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:32.848413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb160d-487f-4084-9b38-3e15769ee81d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:32.865061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 42/75] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:32.865061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.865061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.865061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.886733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:32.888530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:32.939038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa524e-6e6a-4f4a-9ec0-b6676addc698 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:32.993069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:32.993703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:32.993977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:32.994246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:32.996961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 43/76] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:32.997810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.025265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.027144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.029408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 34/77] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.030013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.120232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.150755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376235-7936-4ef7-8b6c-1fa9452b49dc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.184436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247346d-bd7e-4b62-9aa2-9113bd6d686c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.185645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.204643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.205534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.205828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.206176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.223079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:33.228349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:33.229388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 44/78] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:33.230735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.246187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.246845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.247136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.247374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.248080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:33.248385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.249832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.264292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 35/79] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.270147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.345416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158a74-393c-4aad-a39d-113e9204ef60 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.384836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d10461-8272-4845-8881-c9538e63542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.385377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d10461-8272-4845-8881-c9538e63542d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.385692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d10461-8272-4845-8881-c9538e63542d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.386094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d10461-8272-4845-8881-c9538e63542d None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.387433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d10461-8272-4845-8881-c9538e63542d None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.389023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d10461-8272-4845-8881-c9538e63542d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.399787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 45/80] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.399787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d10461-8272-4845-8881-c9538e63542d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.400101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3da-f728-446d-a3ea-504702d3be6a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.431340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.445800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.447062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.447387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.447751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.449519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.510204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d10461-8272-4845-8881-c9538e63542d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.528080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.529556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.550109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.550733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.551164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.551574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.552311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:33.552617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.554234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.568982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 46/81] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.568982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.653435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 36/82] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:33.657404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.679497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b650e5a-176d-4a11-b26a-c0dfc5e26e7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.695496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.706070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.723243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.724474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.724770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.725047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.726614 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.728756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.731704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 47/83] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.732800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.797637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7262-0534-4bd5-a682-41dce821804d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.832920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.833557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.833833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.834101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.835200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.836690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.838453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 37/84] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:33.839067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:33.852872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3612c-728e-4d07-bdbc-ade6e343b67e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.900284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.900894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.901166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.901435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.948910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.955792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e02070-3309-4c71-bcbf-24fa7a2e69c9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:33.967474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:33.988780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.990274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:33.993714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:33.994364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:33.994643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:33.994916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:33.996388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:33.997835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.000041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 38/85] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:34.001100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.113221 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 48/86] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:34.114116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.126395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b44a2-5b14-4255-98b5-25d2d78efb3a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:34.171056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:34.172286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:34.172565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:34.172866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:34.174015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:34.175481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.177190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 39/87] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:34.177971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.222075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.224626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.244849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4cc88-504a-4f34-9d20-489a8c1e31b7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:34.293000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:34.293730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:34.294089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:34.294438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:34.316013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17370-1d16-4947-ada8-d4c759f9480a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:34.358694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:34.360313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:34.360767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:34.361207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:34.362462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:34.364985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.390011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 40/88] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:01:34 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:34.390578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:34.390950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.392391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.504660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.515270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.532369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851dd96-34eb-4c59-ac97-4b247709ecbb None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:34.544326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 49/89] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:34.544326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.588088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:34.588730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:34.589376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:34.589376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:34.683477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:34.685819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe854-05d1-4f9c-a7d7-108c1bf05737 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:34.688930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.749089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:34.749783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:34.750062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:34.750330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:34.751587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:34.753112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:34.754891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 50/90] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:34.755643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.844358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.844546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:34.864625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 41/91] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:34.865684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:34.939216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0ee29-5b56-419a-9abf-5da45fee571f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.018417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.019335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.019786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.020411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.021936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:35.022469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.025074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.035869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 51/92] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=0596a83a84af4342b35541050fc02f35 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:35.037251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:35.056018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452ff0-2a2f-4112-b8a4-74463653285b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.123356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.124409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.124907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.125351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.127380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.130019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.133026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 42/93] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:34 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:35.134731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:35.222576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:35.282415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a69d-d194-4406-8b27-0d2936822526 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.285089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ae6e-1e0a-44b1-9328-87b548c96685 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.318026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:35.327485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.328219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.328564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.328845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] PATH_INFO: `/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.330123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] RBAC: Authorizing `identity:get_project(project_id=5ceeaf52be1d4bf9aef22f81dd2790a0)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.332260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.334403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 43/94] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:35 2022] GET /identity/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:35.335375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:35.357491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.358215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.358566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.358849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.360195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:35.360510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.362112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.368732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 52/95] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:35 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:35.369712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:35.464347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b70cd-1f0b-4252-9f52-6ac27669324d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.501025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:35.521375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.522360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.522788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.523207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.525360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=25e6c04dcaa6467c806fd0a095469485) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:35.525835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.528439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118710fe-f54e-4b97-8a66-7f8cb37151ea None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.539569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 44/96] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:35 2022] GET /identity/v3/role_assignments?user.id=25e6c04dcaa6467c806fd0a095469485&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:35.567361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2214-16af-4fd4-bd31-f2e9a21d40cc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:35.627930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:35.628593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:35.628874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:35.629154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:35.629924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=5ceeaf52be1d4bf9aef22f81dd2790a0, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:35.630236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:35.631798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b1f19-ad35-4551-a6ca-dce15428c101 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:35.639094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 53/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:35 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=5ceeaf52be1d4bf9aef22f81dd2790a0&role.id=0596a83a84af4342b35541050fc02f35 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:37.466795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dc5b-5f60-4efb-a4f4-d5122abf7137 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:37.468341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dc5b-5f60-4efb-a4f4-d5122abf7137 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:37.469217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dc5b-5f60-4efb-a4f4-d5122abf7137 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:37.471891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 45/98] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:37.478476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb68d2-5eba-4970-9189-c67e80f74c34 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:37.479774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb68d2-5eba-4970-9189-c67e80f74c34 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:37.480338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb68d2-5eba-4970-9189-c67e80f74c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:37.516357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4acb68d2-5eba-4970-9189-c67e80f74c34 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:37.518836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4acb68d2-5eba-4970-9189-c67e80f74c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:37.574282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:37.634831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 54/99] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:37.961591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dc5b-5f60-4efb-a4f4-d5122abf7137 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:38.013547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538cf6-7ea5-485b-b124-52e84bc18c53 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:38.014200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538cf6-7ea5-485b-b124-52e84bc18c53 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:38.014684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538cf6-7ea5-485b-b124-52e84bc18c53 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:38.016862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 55/100] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:38.024937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:38.025695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:38.026184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:38.061555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:38.063344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:38.190921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dc5b-5f60-4efb-a4f4-d5122abf7137 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:38.236284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 56/101] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:38.311334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:38.312430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:38.313458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:38.314013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:38.341460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:38.351002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:38.351988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:38.352776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:38.353365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 46/102] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:38.362597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:38.536602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137379-8005-464f-ab8c-5fc27a9eaf40 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:38.539689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:38.602195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:38.602827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:38.603107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:38.603378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:38.604082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:38.604386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:38.605791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:38.620159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 57/103] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:38.629781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:38.729715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:38.802709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f9aa-7b24-4bed-a258-71fad5e831d5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:38.854168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:38.854814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:38.855091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:38.855364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] PATH_INFO: `/v3/users/ed93c9c252b04689b0d95c9b80ce9f29` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:38.873000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] RBAC: Authorizing `identity:get_user(user_id=ed93c9c252b04689b0d95c9b80ce9f29)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:38.874494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:38.876887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 47/104] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:38 2022] GET /identity/v3/users/ed93c9c252b04689b0d95c9b80ce9f29 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:38.885634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:39.013072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:39.034445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc819-6014-47cc-99af-87139327bc68 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:39.077457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:39.078349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.079044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.082255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.139775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:39.211906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:39.213849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:39.247715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4445e7-ba82-487f-9892-399a06e1044e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:39.263059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:39.314223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:39.315701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.316542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.317372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.319540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:39.322661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336bcec-9f7e-45fd-84e5-7a54b447bb30 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:39.326031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 48/105] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:39.334690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86531-517b-4c5a-9bae-1c10e2c0ab70 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.335524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86531-517b-4c5a-9bae-1c10e2c0ab70 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.336278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86531-517b-4c5a-9bae-1c10e2c0ab70 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.339179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 49/106] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:39.343242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9892c-b6c5-4288-8270-e03394391d03 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.345109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9892c-b6c5-4288-8270-e03394391d03 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.345905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9892c-b6c5-4288-8270-e03394391d03 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.348880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 50/107] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:39.353778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 58/108] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:01:39.353778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:39.356715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.357595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.358341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.391722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:39.393177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:39.488402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:39.488816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 51/109] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:39.489757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:39.524834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c26ee-39d5-4b76-8cfe-a4b852cd740b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:39.610664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:39.612936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.613731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.614556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.616108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:39.619382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f860-002d-4125-b24f-f333dc25e617 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:39.663328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d092536-4136-48e1-9f8f-1c9bd952141c None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:39.667130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:39.668034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 59/110] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:01:39 2022] POST /identity/v3/projects => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:39.669433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a3d1-e4bc-4f56-a349-2dca30f47544 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.669720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a3d1-e4bc-4f56-a349-2dca30f47544 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.670006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a3d1-e4bc-4f56-a349-2dca30f47544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.695685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-79a3a3d1-e4bc-4f56-a349-2dca30f47544 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:39.698005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-79a3a3d1-e4bc-4f56-a349-2dca30f47544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:39.727592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:39.728953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.729489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.730044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.732571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:39.735660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1abf-ea2c-4bc9-b69a-c0c692006489 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:39.739350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 52/111] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:39 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:39.741961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74239-f880-4c5d-b168-2954fd524327 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.742587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74239-f880-4c5d-b168-2954fd524327 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.743140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74239-f880-4c5d-b168-2954fd524327 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.745693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 53/112] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:39.748769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed20de-cde5-41e0-8666-88932e7dc370 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.749352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed20de-cde5-41e0-8666-88932e7dc370 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.749907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed20de-cde5-41e0-8666-88932e7dc370 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.753375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 54/113] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:39.755006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed20de-cde5-41e0-8666-88932e7dc370 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:39.796879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 60/114] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:39.798320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d18a1-7bfb-4867-a4e9-2b83d29b23d8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.798654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d18a1-7bfb-4867-a4e9-2b83d29b23d8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.798993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d18a1-7bfb-4867-a4e9-2b83d29b23d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.826913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5b9d18a1-7bfb-4867-a4e9-2b83d29b23d8 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:39.828186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5b9d18a1-7bfb-4867-a4e9-2b83d29b23d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:39.900666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:39.944184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 61/115] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:39.946571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:39.952797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:39.953127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:39.996786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:39.999668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:40.022621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed20de-cde5-41e0-8666-88932e7dc370 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:40.087944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 62/116] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:40.088870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:40.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:40.091524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:40.092079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:40.092555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:40.093928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=ed93c9c252b04689b0d95c9b80ce9f29) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:40.094508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:40.098750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:40.110256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 55/117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:39 2022] GET /identity/v3/role_assignments?user.id=ed93c9c252b04689b0d95c9b80ce9f29&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:40.223471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc393-d5ac-459f-a21a-ad4ee79727c0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:40.232507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:40.265793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:40.266996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:40.267279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:40.267556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:40.280277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:40.285868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:40.286744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:40.287480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 63/118] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:40.298432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:40.304558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:40.431341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:40.464421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66d86-91f7-4d47-8355-dc1148fefbcf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:40.509039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:40.509985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:40.510451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:40.510960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:40.511834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:40.512333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:40.513937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:40.524053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 64/119] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:40.542775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:40.639873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529b54-abb4-4b2b-a34a-d983c3da109d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:40.645370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:40.733666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:40.734483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:40.734888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:40.735320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:40.768845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:40.779160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:40.780132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:40.780884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:40.786062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 56/120] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:40.786062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:40.901816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dc41-42b0-4820-a3c3-b07da5cf189d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:40.971679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:40.972818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:40.973264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:40.973827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:40.976282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:40.979065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:40.982074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 65/121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:40.989991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.022776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.040709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f6bc1-d103-4ed2-9a9e-e522ae5e866a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.114313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.115332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.115787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.116272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.138605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:41.150484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:41.151403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:41.152194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:41.153493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 57/122] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:41.161766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.191183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.202201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa11d6-8fe6-4f56-b9d3-2cf542e1de98 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.264689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.265610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.266132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.266622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.267801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:41.268334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:41.271848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:41.290596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 66/123] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:41.292596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.357216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f53495-6d62-4810-907b-de047c10b270 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.408753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.409859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.410340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.410810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.425289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:41.433626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:41.434557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:41.435305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:41.437822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 58/124] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:41.439080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.467845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.507743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7c8d-0258-4ff4-bb6d-8f36e5425995 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.551809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.552433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.552718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.553000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.554224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:41.556135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:41.557786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 67/125] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:41.558718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.563440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b697ca-41e0-4a4b-a4e5-e90175e6ec2b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.591379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.604329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.605243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.605675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.606097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.606919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:41.607366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:41.608962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:41.619080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 59/126] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:41.625017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.693975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65901d0-a511-4f65-bae5-6f5da7ff93a0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.733850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.759172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.760857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.761607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.762320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.763425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794dcb-8af0-4884-9dec-beab4b61f6eb None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:41.765249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:41.769094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:41.772839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 68/127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:41.774682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.817494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:41.818440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:41.818949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:41.819419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:41.820394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:41.820918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:41.822903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:41.834579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 60/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:41.836044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:41.926887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:41.945514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652acf9c-2aee-439f-98bd-c137d58ec1a7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.014135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.015328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.015619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.015901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/users/383f739d01c541de80f80471834f5e87/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.021238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, user_id=383f739d01c541de80f80471834f5e87, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.025178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.036629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ef4-c0b4-474f-aa47-c9c7e8fc0d21 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.053896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 69/129] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:41 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/users/383f739d01c541de80f80471834f5e87/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:42.056085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.112079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.112079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.112079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.112079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.112467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.112957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.116284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 61/130] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:41 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:42.124479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.144985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:42.340173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25780209-6c3f-4312-add7-5e0561f89464 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.404843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe0faa-cd61-4f87-a7e9-2641208ec010 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.407471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.408827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.409500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.410209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] PATH_INFO: `/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.412321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] RBAC: Authorizing `identity:get_project(project_id=5ceeaf52be1d4bf9aef22f81dd2790a0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.414885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.418744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 70/131] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:42 2022] GET /identity/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0 => generated 312 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:42.420997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.451307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.452188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.452462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.452747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.453989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.455815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.457845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 62/132] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:42 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:42.458696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.473590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:42.612564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75793b-feb8-4fcd-86b9-50b0b0d0b281 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.637733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:42.686476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.687371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea102b-4658-4b31-842d-90e918574fe6 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.687556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.688090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.689173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.691124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.694247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.698520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 71/133] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:42 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:42.698906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.746218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.747340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.748133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.748544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] PATH_INFO: `/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0/users/383f739d01c541de80f80471834f5e87/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.751009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ceeaf52be1d4bf9aef22f81dd2790a0, user_id=383f739d01c541de80f80471834f5e87, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.753747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158405da-b75b-4a64-a0e1-755ed448d5c7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.772637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 63/134] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:42 2022] PUT /identity/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0/users/383f739d01c541de80f80471834f5e87/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:42.775753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab9b5-e3b7-4667-a5c5-1c5952d23977 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.776246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab9b5-e3b7-4667-a5c5-1c5952d23977 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.776679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab9b5-e3b7-4667-a5c5-1c5952d23977 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.780561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 64/135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:42.783597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638c20-e69d-4cd3-a238-882057700019 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.784066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638c20-e69d-4cd3-a238-882057700019 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.784499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638c20-e69d-4cd3-a238-882057700019 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.791082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 65/136] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:42.791082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638c20-e69d-4cd3-a238-882057700019 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:42.885981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:42.905946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c41ed-2db1-467f-ba13-5c0324b3d6dd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.958805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638c20-e69d-4cd3-a238-882057700019 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:42.974791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:42.976230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.976924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.977430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:42.980069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:42.983411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975d4d-7626-432f-abb1-9770a53caa3c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:42.988451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 72/137] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:42 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:42.991407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:42.992479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:42.993528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:43.026972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:43.027595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:43.028860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:43.029355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:43.029866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/users/383f739d01c541de80f80471834f5e87/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:43.031126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:43.034950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, user_id=383f739d01c541de80f80471834f5e87, role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:43.038050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d3d7-a9ef-4bbc-ad16-2dff0b31b039 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:43.046121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:43.073227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 66/138] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:42 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/users/383f739d01c541de80f80471834f5e87/roles/75e15a3f70704e038e150ee93dfacae2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:43.074267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:43.074664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:43.074928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:43.102284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:43.103546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:43.190058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:43.191607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:43.312970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 67/140] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:43.457771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:43.495056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f0ea-1b32-463c-957b-56a83ce31c5e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:43.586631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:43.588310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:43.589147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:43.589933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/users/25e6c04dcaa6467c806fd0a095469485/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:43.602431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, user_id=25e6c04dcaa6467c806fd0a095469485, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:43.605818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:43.629813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:43 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/users/25e6c04dcaa6467c806fd0a095469485/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:43.667176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:43.793382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:43.958067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cf07f-c046-4b80-a6bb-29053a26e2bf None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:44.019656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d4f7-d5f3-4fc5-8c9a-0c3c6c9ccf9c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:44.051326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:44.063251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:44.064528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:44.064810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:44.065080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:44.077729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:44.082915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:44.084571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:44.086031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 75/142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:44.090576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:44.091606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:44.092684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:44.093158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:44.093625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:44.101369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:44.104018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:44.107083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 68/143] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:44.113149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:44.116681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:44.357380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b032c-43c9-4fed-8d1b-26f94e8e0789 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:44.366234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385631a-970c-47e8-9062-4f492755e7e7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:44.481111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:44.482119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:44.482601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:44.483079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:44.484188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:44.489636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:44.490594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:44.491043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:44.491486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:44.492629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:44.493126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:44.495456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:44.498441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:44.527391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 76/144] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:44.537919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:44.568883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 69/145] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:01:44 2022] POST /identity/v3/users => generated 283 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:44.716776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:44.787534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab94b2-3a50-404c-88b6-199420d39cf8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:44.847210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:44.848108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:44.848231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:44.848574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] PATH_INFO: `/v3/users/ed93c9c252b04689b0d95c9b80ce9f29` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:44.849707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] RBAC: Authorizing `identity:get_user(user_id=ed93c9c252b04689b0d95c9b80ce9f29)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:44.851187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:44.852846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 77/146] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:44 2022] GET /identity/v3/users/ed93c9c252b04689b0d95c9b80ce9f29 => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:44.859507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:44.964810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:45.062749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef447f5-a7af-4fd8-a73f-e83f523cdc1d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:45.133842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:45.134902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:45.135385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:45.135874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:45.137926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:45.140539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225735-dfe1-4e75-aec0-fee31d624604 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:45.144090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 70/147] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:44 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:45.163996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:45.340722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10324a6-f6b7-4f1a-87c0-47efcef18c3a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:45.389613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:45.390303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:45.390582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:45.393460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/users/ed93c9c252b04689b0d95c9b80ce9f29/roles/bfc61d67e6b5440684bbe466e358a8ab` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:45.401523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, user_id=ed93c9c252b04689b0d95c9b80ce9f29, role_id=bfc61d67e6b5440684bbe466e358a8ab)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:45.403041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b5196-cee9-4ff7-9be1-03b85d5bc0be None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:45.413764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:45.418646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 78/148] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:45 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/users/ed93c9c252b04689b0d95c9b80ce9f29/roles/bfc61d67e6b5440684bbe466e358a8ab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:45.651592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f938b4a-ec69-4ee6-a876-a2d71d22af9a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:45.651987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f938b4a-ec69-4ee6-a876-a2d71d22af9a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:45.652458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f938b4a-ec69-4ee6-a876-a2d71d22af9a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:45.655196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 71/149] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:45.661782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:45.662274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:45.662782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:45.705558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:45.706802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:45.814780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 79/150] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:46.361958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f938b4a-ec69-4ee6-a876-a2d71d22af9a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:46.539672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f938b4a-ec69-4ee6-a876-a2d71d22af9a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:46.560365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:46.581029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:46.581682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:46.581958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:46.582231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:46.594683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:46.599867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:46.600801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:46.601620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 72/151] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:46.607829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:46.751300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f34c7-9116-4337-9984-92c008d9fb60 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:46.792777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:46.802637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:46.803264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:46.803543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:46.803813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:46.804521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:46.804827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:46.806224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:46.820405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 80/152] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:46.829114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:46.965482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d550-b2e7-410b-bea6-9e5feebf9898 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:47.017069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:47.017758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.018039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.018314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.019487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:47.020998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647bbb-d0e5-45ee-ab12-ef3447251185 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:47.022633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 73/153] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:46 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:47.031349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:47.055691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e75e-15b8-4e50-ad32-91e03c0363c4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.055994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e75e-15b8-4e50-ad32-91e03c0363c4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.056291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e75e-15b8-4e50-ad32-91e03c0363c4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.057918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 74/154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:47.063506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22db-4a95-48a8-a0ec-0951080a73e8 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.063780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22db-4a95-48a8-a0ec-0951080a73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.064153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22db-4a95-48a8-a0ec-0951080a73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.103439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ccdb22db-4a95-48a8-a0ec-0951080a73e8 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:47.105120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ccdb22db-4a95-48a8-a0ec-0951080a73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:47.209879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:47.260322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 75/155] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:47.271272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecde3-966a-4025-9e10-f0a903413b98 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.271842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecde3-966a-4025-9e10-f0a903413b98 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.272308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecde3-966a-4025-9e10-f0a903413b98 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.274188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 76/156] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:47.276468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526a59b-60d7-412a-8fff-f33a86c3241b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:47.280760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.281301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.281741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.313840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:47.315448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:47.388765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:47.389814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.390296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.390772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.428430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 77/157] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:47.523723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:47.538371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:47.540348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73941a-4ff7-404b-b6c0-077633d02918 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:47.670658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 81/158] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:47.677832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:47.826916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46c9a-4f9f-4d2a-809f-59eea8a85b76 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:47.835831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:47.866041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d49d4-568b-4a38-9276-dad0681f510c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.866670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d49d4-568b-4a38-9276-dad0681f510c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.867226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d49d4-568b-4a38-9276-dad0681f510c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.872332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:47.872986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.873266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.873538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.873829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 82/159] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:47.875417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:47.877079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82730-914a-43b3-be31-145ba7d12fd5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:47.878987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 78/160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:47 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:47.887894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d49d4-568b-4a38-9276-dad0681f510c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:47.890186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:47.890473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:47.890743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:47.913156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:47.914914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:48.002181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 79/161] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:48.093408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:48.107103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d49d4-568b-4a38-9276-dad0681f510c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:48.155293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:48.155926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:48.156236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:48.156505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:48.157260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:48.157567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:48.159098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:48.170547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 83/162] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:47 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=0596a83a84af4342b35541050fc02f35 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:48.187180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:48.277566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:48.332359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023e22-11d4-47a4-835c-44a602a5d21f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:48.348041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:48.408215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:48.408917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:48.409198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:48.409817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:48.446339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:48.453464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:48.455223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:48.456857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 80/163] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:48.464638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:48.541572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4539fee-ff02-4133-9fdd-215cfe16b365 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:48.630542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:48.631229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:48.631511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:48.631780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:48.661148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:48.666351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:48.667302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:48.668083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 84/164] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:01:48.668712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:48.706273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:48.758425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbdea-cbb8-4d51-bd50-72c0c57df738 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:48.849649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:48.850276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:48.850555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:48.850819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:48.851499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:48.851797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:48.857394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:48.877832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 81/165] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:48.878743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:48.928643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a232-f7a3-4830-bb34-1eab7747e6c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:48.960362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:49.013432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.014079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.014359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.014631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.046060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:49.051628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:49.052517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:49.053278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 85/166] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:49.053970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:49.151283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d4a3-e361-4e20-a606-32b966486a82 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:49.251386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.252043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.252363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.252650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.253338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:49.253642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:49.255044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:49.281744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:49.288782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 82/167] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:49.289556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:49.358590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd415d7-c6b7-4706-a642-6e229057623d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:49.442876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.443437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.443859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.444170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.445847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:49.447924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:49.450628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 86/168] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:49 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:49.452672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:49.499018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:49.529610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7880b-a26e-455b-9948-b094f6f58867 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:49.582283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.582911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.583190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.583460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.584186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:49.584486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:49.588028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:49.595621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 83/169] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:49.597125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:49.656397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b959-6ef9-4e78-a380-640d14ed7dc3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:49.709089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9be0e-9268-433a-bdb6-a6df68778671 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:49.747691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.748362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.748638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.748913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.773514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:49.781346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:49.783455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:49.784292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:49.785054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] PATH_INFO: `/v3/users/383f739d01c541de80f80471834f5e87` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:49.787520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] RBAC: Authorizing `identity:get_user(user_id=383f739d01c541de80f80471834f5e87)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:49.790792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:49.800127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 87/170] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:49 2022] GET /identity/v3/users/383f739d01c541de80f80471834f5e87 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:49.801670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:49.829545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:49.877260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:49.880705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:50.007668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0482ab-5e7f-46e4-8809-ae4eb30b0228 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:50.072478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:50.072742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.073046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.073189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] PATH_INFO: `/v3/users/25e6c04dcaa6467c806fd0a095469485` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.074556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] RBAC: Authorizing `identity:get_user(user_id=25e6c04dcaa6467c806fd0a095469485)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:50.084159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:50.084159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 88/171] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:49 2022] GET /identity/v3/users/25e6c04dcaa6467c806fd0a095469485 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:50.084159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:50.199560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 84/172] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:50.201336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:50.248376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:50.262309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:50.279326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d088-17ac-4369-84a7-d58684bc04fc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:50.325470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:50.326698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.326898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6e97-ba60-406b-885a-534c16433f7a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:50.327553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.328427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.372725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:50.373381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.373659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.373959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.446488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:50.450042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b685a-fd83-4d3e-9c78-aa0127a51cbb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:50.462473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:50.466036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf17022-6b0a-409d-8888-9b36c7f4ffad None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:50.544644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:50.612630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 85/173] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:50.613812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce13-376b-4a08-897b-c486c62234b1 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.614096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce13-376b-4a08-897b-c486c62234b1 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.614363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce13-376b-4a08-897b-c486c62234b1 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.615832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 86/174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:50.617294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bce13-376b-4a08-897b-c486c62234b1 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:50.617860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:50.646184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 89/175] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:50.647841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86cdf-a83a-4bd1-9c89-1922a5403f7d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.648152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86cdf-a83a-4bd1-9c89-1922a5403f7d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.648427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86cdf-a83a-4bd1-9c89-1922a5403f7d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.649860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 90/176] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:50.654188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4a7a2-f117-41b5-8d53-0e675b571c72 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.654469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4a7a2-f117-41b5-8d53-0e675b571c72 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.654867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4a7a2-f117-41b5-8d53-0e675b571c72 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.656599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 91/177] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:50.660009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.660009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.660009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.678866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:50.680309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:50.737741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bce13-376b-4a08-897b-c486c62234b1 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:50.756172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 92/178] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:50.757063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:50.782668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:50.783322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.783594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.783897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.785662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:50.787116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa5b3-621c-44f7-876f-9d8db37496d9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:50.789018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 87/179] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:50 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:50.790106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea64de-add2-40a7-8c11-89c1b7a190d5 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.790390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea64de-add2-40a7-8c11-89c1b7a190d5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.790660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea64de-add2-40a7-8c11-89c1b7a190d5 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.792635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 88/180] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:50.797664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:50.797839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:50.798117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:50.820096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:50.821306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:50.838297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:50.916686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 89/181] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:50.918621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:50.955107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0f301-5da1-40cd-a39c-9b8418bae25c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:50.973036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:51.012346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.013980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.014630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.015874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.018976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:51.022670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470756a-a1c0-4cd8-9260-6af2f0eb711c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:51.025970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 93/182] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:50 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:51.029167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.029870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.030527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.064835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:51.067009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:51.129397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda370-9cd7-493b-9ea0-3b863c1163e4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.177759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 94/183] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:51.181412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.211706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.213886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.214685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.215364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] PATH_INFO: `/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.217770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=5ceeaf52be1d4bf9aef22f81dd2790a0)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:51.222231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea24d33-ac94-40f2-b92d-f0b2e0037ff9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:51.226335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 90/184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:50 2022] GET /identity/v3/projects/5ceeaf52be1d4bf9aef22f81dd2790a0 => generated 312 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:51.228800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.229568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.230195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.262812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:51.264064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:51.277783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:51.330345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461f683-e552-4d9a-b577-97a7e40471f2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.347739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:51.381341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.382054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.382389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.382707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.383517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:51.383908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:51.385511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:51.386007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 91/185] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:51.387631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.403119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 95/186] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:51.405547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.621972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321ff8-da21-46ca-a71e-052e767a6232 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.642459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d65d-75c8-4837-89ad-8303630e4a34 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.708084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.709108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.709595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.710936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.711733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=25e6c04dcaa6467c806fd0a095469485) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:51.712266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:51.714648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:51.722327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.723493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.724258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.724750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.726908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 92/187] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/role_assignments?user.id=25e6c04dcaa6467c806fd0a095469485&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:51.728459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.741249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:51.746964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:51.747900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:51.749023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 96/188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:51.749749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.753978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:51.797026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:51.903448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c8e87-fc0b-482c-93b9-7adf53796b2f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.933869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5ee5-e371-4657-b79e-e5d860136ac6 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:51.944744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.945396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.945670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.945933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:51.959744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:51.966265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:51.967232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:51.968046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 97/189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:51.968711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:51.998004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:51.998744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:51.999030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:51.999308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.000421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=5ceeaf52be1d4bf9aef22f81dd2790a0, user.id=383f739d01c541de80f80471834f5e87) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:52.000694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.002197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.013603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 93/190] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/role_assignments?user.id=383f739d01c541de80f80471834f5e87&scope.project.id=5ceeaf52be1d4bf9aef22f81dd2790a0&role.id=0596a83a84af4342b35541050fc02f35 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.015179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.093194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.118202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c028-6d46-471a-a8d1-87db5a9bff15 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.140862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.174493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.175849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.176252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.176436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.177732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.179538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.181590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 98/191] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.181884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.203094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095565e-5c97-46c6-9646-d8be06b1d8df None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.269749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.270460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.270750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.271231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.284360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:52.289881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:52.291818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 94/192] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:52.293216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.371887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8b6f-9cef-40dd-b20f-f2ef0c29c01b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.416706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.417329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.417693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.417891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.418659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:52.418936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.420418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.430678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 99/193] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.431522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.459227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dead635-a7e8-4419-899d-a61ded1db80b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.461558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.504832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.505611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.505940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.506259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.507132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:52.507587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.509417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.511424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.524574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 95/194] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.526024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.564473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef8efc-31dc-497f-9c34-dc1ddeb97366 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.608143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.609036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.609311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.609581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.610260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.611732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.643788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 100/195] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:01:52 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:01:52.649738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.654233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca13a3-346a-41e9-953b-7c2b5deb6069 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.699173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.700090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.700553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.701012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.701925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:52.702375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.704315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.716730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 96/196] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.717715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.805186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.805454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:52.855247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e7efc-746a-4266-8648-184bcfb8ee24 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.895771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b259937-cbad-47c3-acaa-6f82bf6326d0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:52.913882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.914709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.915178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.915601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.937444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.939035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.940873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 101/197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.941527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:52.947613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:52.948755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:52.949896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:52.949896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] PATH_INFO: `/v3/users/ed93c9c252b04689b0d95c9b80ce9f29` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:52.951834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed93c9c252b04689b0d95c9b80ce9f29)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:52.954639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:52.960161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 97/198] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/users/ed93c9c252b04689b0d95c9b80ce9f29 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:52.961611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:53.121642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c2e4-b109-4b5f-ba0c-2f18f9ef060b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:53.159735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37a62-4fda-43d3-a390-4d62ae9355e0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:53.204007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:53.205020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:53.205517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:53.206004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:53.208245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:53.210723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:53.213693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 102/199] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:53.215048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:53.220368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.230740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.250953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:53.252367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:53.253067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:53.254531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:53.345884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:53.348846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:53.432597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffc482-5b9e-4eef-86a3-def98d8ea8b6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:53.482165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 98/200] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:53.483278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:53.507496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:53.508605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:53.509086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:53.510126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:53.517013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.614642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209a59-23e0-4482-9769-992f0d566a68 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:53.642212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:53.645527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:53.648097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.664811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:53.665688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:53.666010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:53.666436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:53.759982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:53.761516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:53.780665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 103/201] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:53.781816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:53.818404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.936134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:01:53.937977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:53.941282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff21db-d87b-42ec-8304-376dc1886158 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:53.944252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:53.996701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:53.998043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:53.998524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:53.999130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.001158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.004304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.008030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 104/203] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:53 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:54.009877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:54.067926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad08fe-f7f8-45b1-8aac-3f82dcffdbb8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:54.102205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:54.113088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:54.113745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:54.114020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:54.114296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.115476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.116987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.126714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:53 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:54.126714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:54.215418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9fdd9-c84f-4349-b569-55f573c026c8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:54.261036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e383c-8784-410d-951e-d3cf65c3c022 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:54.284381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:54.286056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:54.286800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:54.287535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.289929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.293159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.297303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 105/205] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:54 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:54.299176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:54.319446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:54.319998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:54.320270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:54.320526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.321261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:54.321567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.323447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.330395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 101/206] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:54 2022] GET /identity/v3/role_assignments?user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:54.331236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:54.387734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:54.433080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:54.558594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9627-6df3-4cdb-8323-c0aea8260b4f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:54.570029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c3e2-f8ff-429a-ab95-953fbe958f0b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:54.610292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:54.610919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:54.611208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:54.611464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.612262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:54.612572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.620964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246f7ab-954d-4b32-81b1-5e155d15b9ef None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.632543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 102/207] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:54 2022] GET /identity/v3/role_assignments?user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:54.644627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:54.645615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:54.646111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:54.646598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:54.647799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, scope.project.id=6f59e478e01549da910641dbb52ad42d, user.id=ed93c9c252b04689b0d95c9b80ce9f29) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:54.648512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:54.650767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94021585-efb1-4eb5-bbb3-7c77dc31fc2d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:54.658653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 106/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:54 2022] GET /identity/v3/role_assignments?user.id=ed93c9c252b04689b0d95c9b80ce9f29&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:55.232682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cf05-a65b-42e1-a07b-3a054d6da54a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.233636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cf05-a65b-42e1-a07b-3a054d6da54a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.234111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cf05-a65b-42e1-a07b-3a054d6da54a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.236017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 103/209] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:55.242272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.243216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.243696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.268674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:55.270456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:55.315682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6216d5-7e61-47bb-ab7d-6d6eab98bef6 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.316588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6216d5-7e61-47bb-ab7d-6d6eab98bef6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.316866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6216d5-7e61-47bb-ab7d-6d6eab98bef6 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.318464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 104/210] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:55.324551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.325186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.325664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.345177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:55.346733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:55.352514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 107/211] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:55.425236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 105/212] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:55.633704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:55.674397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:55.703190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:55.759752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d921a-1335-4f06-b44d-c9e34908ef99 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:55.766417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:55.801989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:55.803032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.803444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.803854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.819141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:55.820329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c50d8-7222-4e3f-8d6a-493ebffaac4b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:55.826079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:55.827166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:01:55.828154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:01:55.830145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 108/213] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:55.837346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:55.880254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:55.880954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:55.881230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:55.881499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:55.885147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:55.889345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:55.896279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 106/214] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:01:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:55.901930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:56.000211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:56.014836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766fb1-7c9b-4c08-8a43-8e85cbe61e66 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:56.048385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a9a5-c2e5-4f12-9b78-a453194a4309 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:56.061319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:56.062186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.062608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.063019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.063841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:56.064362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:56.065899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:56.077899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 109/215] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:56.083233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:56.093671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:56.110603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:56.111236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.111519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.111794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.112565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:56.114622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:56.150206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 107/216] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:01:55 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:01:56.251493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4557-5abe-42f8-8607-a6502c197f41 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:56.302022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:56.302687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.303020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.303355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] PATH_INFO: `/v3/users/7cf23853bc5e4357b511d9e3a242950a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.320617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf23853bc5e4357b511d9e3a242950a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:56.322177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:56.324300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 110/217] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:56 2022] GET /identity/v3/users/7cf23853bc5e4357b511d9e3a242950a => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:56.330182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:56.452256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8454ad-8e7a-4936-acd4-b3068d1783b3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:56.495363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:56.496020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.496298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.496569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.554965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:56.584010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:56.585813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b2c58-daac-4cb6-b973-d3f4e4db2616 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:56.717223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 108/218] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:01:56.724730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:56.749992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:56.862509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64859c9-c537-455f-8333-4889f815df73 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:56.905810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe1cf-00cb-44e0-8c0e-b7c97aeeea1d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.906156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe1cf-00cb-44e0-8c0e-b7c97aeeea1d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.906340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe1cf-00cb-44e0-8c0e-b7c97aeeea1d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.907943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 109/219] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:56.909991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:56.911167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.911449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.911722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.917921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd308cd-bf28-4b7e-91f1-f8436bb63a01 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:56.918201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd308cd-bf28-4b7e-91f1-f8436bb63a01 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:56.918498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd308cd-bf28-4b7e-91f1-f8436bb63a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:56.919359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:56.921045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:56.923331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:56 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:56.946229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-dbd308cd-bf28-4b7e-91f1-f8436bb63a01 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:56.947454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-dbd308cd-bf28-4b7e-91f1-f8436bb63a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:56.951530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:57.094104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 110/221] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:57.124104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:57.142073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa7039-9a8c-4416-b98b-34f569c9be5a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:57.193035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:57.194029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:57.194484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:57.194901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:57.196482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=7cf23853bc5e4357b511d9e3a242950a) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:57.197030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:57.199776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6a2ca-ac77-4093-921e-924e36e7d558 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:57.207922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 112/222] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:01:56 2022] GET /identity/v3/role_assignments?user.id=7cf23853bc5e4357b511d9e3a242950a&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=0596a83a84af4342b35541050fc02f35 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:01:57.447439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed21e8-a33e-462c-8604-1d9a2e830f06 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:57.448168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed21e8-a33e-462c-8604-1d9a2e830f06 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:57.448308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed21e8-a33e-462c-8604-1d9a2e830f06 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:57.450937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 111/223] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:57.458305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:57.458841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:57.459236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:57.498605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:57.500541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:57.641706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 113/224] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:01:57.654193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed21e8-a33e-462c-8604-1d9a2e830f06 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:57.671172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:57.858537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed21e8-a33e-462c-8604-1d9a2e830f06 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:57.919494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:57.920487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:57.920929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:57.921350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:57.939883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:57.946431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:57.948524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:57.950498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:57.955719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.097682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:58.144251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.160335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f760-3b3d-45b2-ab4e-3fbe054d59bd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:58.271021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:58.272080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:58.272559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:58.273030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:58.274292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:58.274814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:58.279833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:58.297531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:58.308991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.346913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:58.446200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc77909-3ddf-4759-9c8d-d6cf666113a5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:58.516637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:58.518909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:58.519675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:58.520429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:58.542033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:01:58.553202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:01:58.555215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:01:58.557042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:01:58.558489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfc00-8088-4a7d-ba6f-8446f58a299f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:58.561996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:01:58.570791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.615825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:58.616505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:58.616789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:58.617061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:58.621428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:58.622932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:58.624738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:58 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:58.635351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.643269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:58.818920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43803e6-195f-4cf1-9158-bf57ad1c6065 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:58.836985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c1d37-0c76-4afa-9eaa-7beedf732d1b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:58.850337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:58.873477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:58.874755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:58.875461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:58.876210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:58.878099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:01:58.881431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:58.884325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:58.922608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:58.929434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:58.938597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:58.941897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:58.942370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:58.942847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:58.953316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:58.955917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:58.961068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 116/230] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:58 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:58.989605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:59.123627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcaf2a-e773-4f48-8261-5d3fc541e551 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:59.170302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:59.170302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.170302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.170302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.170953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:59.180001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:59.180001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 115/231] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:01:58 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:59.180366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:59.183026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:59.249200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212149ab-546c-4d9b-a3d7-83ee2daf555a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:59.278793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:59.325456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:59.326145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.326428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.326703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/users/aa727e0adb8c4cd5bcb94480aa8d8bdc/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.329698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:59.331163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:59.357038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 117/232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:58 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/users/aa727e0adb8c4cd5bcb94480aa8d8bdc/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:01:59.366385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca2ec-d69c-482c-93ae-e5a3a4c3db17 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:59.412914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:59.413504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.413784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.414114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.415413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:59.417096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf521-43b3-485d-a82e-175470d22b23 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:59.419399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 116/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:01:59 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:01:59.424886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:01:59.552351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e3b5-6747-48c0-b772-be1e1f18ea43 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:01:59.573387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dc33-d53c-4941-af5c-9ff5b9ceaea3 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.574055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dc33-d53c-4941-af5c-9ff5b9ceaea3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.574055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dc33-d53c-4941-af5c-9ff5b9ceaea3 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.575364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 117/234] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:01:59.593991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad70c-0d55-45cf-b05a-c806506edeb0 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.594302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad70c-0d55-45cf-b05a-c806506edeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.594533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad70c-0d55-45cf-b05a-c806506edeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.612540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:01:59.615888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-72dad70c-0d55-45cf-b05a-c806506edeb0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:01:59.616705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:01:59.617146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-72dad70c-0d55-45cf-b05a-c806506edeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:01:59.617390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.617846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.618129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/users/aa727e0adb8c4cd5bcb94480aa8d8bdc/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.620426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc, role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:01:59.621924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0278-f9f6-4276-a48a-90e8821febe3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:01:59.658966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 118/235] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:01:59 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/users/aa727e0adb8c4cd5bcb94480aa8d8bdc/roles/75e15a3f70704e038e150ee93dfacae2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:01:59.707232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 118/236] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:01:59.987786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc8f4-e720-4458-9009-e92d611615e3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.988160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc8f4-e720-4458-9009-e92d611615e3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.988333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc8f4-e720-4458-9009-e92d611615e3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:01:59.990684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 119/237] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:01:59.997282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7b61-948a-4be1-aab3-31778edb6bb3 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:01:59.997637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7b61-948a-4be1-aab3-31778edb6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:01:59.997922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7b61-948a-4be1-aab3-31778edb6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.025286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e62f7b61-948a-4be1-aab3-31778edb6bb3 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:00.026530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e62f7b61-948a-4be1-aab3-31778edb6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:00.061426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc8f4-e720-4458-9009-e92d611615e3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:00.101544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:00.124578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:00.204705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcba8-f971-470d-8f83-7adba1b657ab None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.205238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcba8-f971-470d-8f83-7adba1b657ab None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.205566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcba8-f971-470d-8f83-7adba1b657ab None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.207283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 120/239] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:00.213795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.214178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.214358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.233694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:00.234908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:00.255732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc8f4-e720-4458-9009-e92d611615e3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:00.360789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:00.361060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 121/240] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:00.362114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.362395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.362727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.364827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:00.366879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:00.374047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 120/241] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:00.375777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:00.490425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:00.634565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379d09a-c830-4eff-a019-589999d203e7 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:00.666347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:00.666542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:00.691521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:00.693013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.693693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.694318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.695261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:00.697381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:00.726441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a74358-52e1-4c64-bdc5-80daba1adb03 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:00.728276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 122/242] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:00 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:00.731519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:00.818083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:00.819142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.819618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.821537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:00.851336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:00.861885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:00.862852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:00.863645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:00.867888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 121/243] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:00.873513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:00.941622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0874-baf7-4bb0-bdea-0152849c3acc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:00.995462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:00.996259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:00.996541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:00.996813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.011704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:01.019201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:01.020223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:01.021025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:01.023992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 123/244] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:01.027178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.064127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229cc3-39a4-48ab-ba64-b06d447ef78d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.075134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:01.100694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:01.123124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.123924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.124377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.124703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.125492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:01.125803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:01.128964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:01.139713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 122/245] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:01.149914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.194809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa9c1-3cf9-45c7-9053-2a43207eb8b0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.238517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.239199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.239627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.239905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.240745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:01.241057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:01.243535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:01.256449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 124/246] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:01.267996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.321904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df10938-ecac-45bd-8f6a-0e89adc35247 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.399680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.400975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.401444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.401917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] PATH_INFO: `/v3/users/7cf23853bc5e4357b511d9e3a242950a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.404125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf23853bc5e4357b511d9e3a242950a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:01.406995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:01.410751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 123/247] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:01 2022] GET /identity/v3/users/7cf23853bc5e4357b511d9e3a242950a => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:01.420857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.449226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:01.463243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1d85-4767-4dcd-ad4a-47c32cbf8403 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.539711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.541163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.541626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.542080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] PATH_INFO: `/v3/users/4071b53de7e940738ac5a20b1e41610b` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.544031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:01.578961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] RBAC: Authorizing `identity:get_user(user_id=4071b53de7e940738ac5a20b1e41610b)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:01.584842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:01.587994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 125/248] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:01 2022] GET /identity/v3/users/4071b53de7e940738ac5a20b1e41610b => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:01.601733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.675416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8200-07fb-4ea5-b630-a6b17a38bbc8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.777169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.779539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.780510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.781269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.783628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:01.787285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:01.791767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 124/249] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:01 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:01.799999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:01.816797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a770a-da4f-4116-80fa-538f06870479 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:01.925399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:01.926388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:01.927390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:01.927851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:01.951772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:02.073077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:02.073946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc8c2d-eee8-4330-b4be-0efe52eb189d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:02.074555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:02.109348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:02.131850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:02.132975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:02.133467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:02.133995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/users/7cf23853bc5e4357b511d9e3a242950a/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:02.136727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, user_id=7cf23853bc5e4357b511d9e3a242950a, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:02.138565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:02.166921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 125/250] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:01 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/users/7cf23853bc5e4357b511d9e3a242950a/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:02.292047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 126/251] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:02.303083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:02.457667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b25f8-9045-44c3-b745-7f0acb1db1fb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:02.502081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:02.503050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:02.503329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:02.503662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:02.505645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:02.507127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b0c2b-fdbe-4bf4-baf3-76a5e695f3e6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:02.509083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 126/252] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:02 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:02.520218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:02.571527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e6e-5f3e-4d63-8b18-9ac59ca164e2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:02.571851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e6e-5f3e-4d63-8b18-9ac59ca164e2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:02.572082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e6e-5f3e-4d63-8b18-9ac59ca164e2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:02.573507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 127/253] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:02.579527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fbba-8f87-4364-b3b7-886b05f0010d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:02.579819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fbba-8f87-4364-b3b7-886b05f0010d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:02.580102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fbba-8f87-4364-b3b7-886b05f0010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:02.614062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ee01fbba-8f87-4364-b3b7-886b05f0010d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:02.616361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ee01fbba-8f87-4364-b3b7-886b05f0010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:02.659403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:02.761932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:02.821093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 128/254] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:02.846991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181909a4-d137-45f9-9e37-3382fc91ccfc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:02.935879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:02.936839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:02.937249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:02.937645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:02.938823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=4071b53de7e940738ac5a20b1e41610b) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:02.939283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:02.941769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0d8a-e7ea-407e-9890-7d92486f9648 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:02.955058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 127/255] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:02 2022] GET /identity/v3/role_assignments?user.id=4071b53de7e940738ac5a20b1e41610b&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 259 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:03.168487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573887f-900a-4f53-beae-c7aeac60c3b1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:03.168761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573887f-900a-4f53-beae-c7aeac60c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:03.169034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573887f-900a-4f53-beae-c7aeac60c3b1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:03.170450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 129/256] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:03.176548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:03.177745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:03.178222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:03.201935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:03.203632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:03.307449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 128/257] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:03.408083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573887f-900a-4f53-beae-c7aeac60c3b1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:03.657991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573887f-900a-4f53-beae-c7aeac60c3b1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:03.730332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:03.731358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:03.731821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:03.732328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:03.751735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:03.762016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:03.763411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:03.764210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:03.764796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 130/258] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:03.777174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:03.859018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:03.971510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:03.993271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357be8-6f2c-4d82-8316-3ca63273f4c5 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:04.104430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:04.109882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:04.110905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:04.111201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:04.111575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:04.112376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:04.112741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:04.114269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:04.136888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 129/259] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:04.142727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:04.288865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603f99-e7db-405d-99e2-2ee4d8cb45f6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:04.414749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:04.415773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:04.416276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:04.416769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:04.442111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c867cc-83a0-4da9-9396-28bd4f7d5db5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:04.458571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:04.461263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:04.471088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:04.472881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:04.474508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:04.481869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 131/260] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:04.501694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:04.514962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:04.514962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:04.514962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:04.514962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:04.516128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:04.517561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:04.519501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 130/261] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:04 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:04.525146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:04.715184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bb4a-5036-4009-8031-50327da8fdb1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:04.766187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:04.766823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:04.767108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:04.767391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:04.824366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:04.831414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb52a3-85c5-4eaf-a266-653e6592dd5a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:04.855023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:04.889512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:04.891842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da2bb-4eec-4487-acb7-cc00d9b4a3b1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:04.907175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:04.907777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:04.908174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:04.908574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:04.909339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:04.909736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:04.911414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:04.928368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 132/262] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:04.951492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:05.021690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 131/263] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:02:05.023234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154b16-9434-43fd-b2a1-32e765dc32fe None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.023677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154b16-9434-43fd-b2a1-32e765dc32fe None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.024110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154b16-9434-43fd-b2a1-32e765dc32fe None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.025885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 132/264] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:05.031832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.032433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.032895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.069281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:05.071990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:05.191809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2eb8-85cb-4ccd-8ceb-37d2df83e850 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:05.241385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 133/265] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:05.242803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:05.250902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:05.276324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:05.277227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.277712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.278671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] PATH_INFO: `/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.285248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] RBAC: Authorizing `identity:get_user(user_id=aa727e0adb8c4cd5bcb94480aa8d8bdc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:05.289027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:05.292208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 133/266] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:04 2022] GET /identity/v3/users/aa727e0adb8c4cd5bcb94480aa8d8bdc => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:05.303240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:05.357500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:05.384976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f418-4bfa-4130-a8b5-db701b517d84 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:05.472380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:05.473312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.479239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.479734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.481526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:05.483317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:05.485643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 134/267] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:05 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:05.493325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:05.544784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d9b-1aa6-4ad9-966a-c9d46d0164d5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:05.624756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:05.625397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.625397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.626897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.654534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:05.728226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:05.729776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:05.767864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:05.775539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff1ae-5911-4727-a6f8-2eb87ad19387 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:05.862808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:05.864659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.864981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.865253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.868205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:05.868560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:05.871524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a813e91-179a-4410-b6ff-949e24730e4b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:05.894844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 135/268] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:05 2022] GET /identity/v3/role_assignments?user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:05.897020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa676-5c3d-4796-8e5c-96ebfaa51fe9 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.897344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa676-5c3d-4796-8e5c-96ebfaa51fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.897623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa676-5c3d-4796-8e5c-96ebfaa51fe9 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.900153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 136/269] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:05.909185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:05.909586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:05.909872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:05.930275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 134/270] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:05.931190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:05.936456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:05.937932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:06.031525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 137/271] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:06.032485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:06.126266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:06.164745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bcd5c-75ef-4925-a67c-78add3797312 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:06.176526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efc8e-1aff-4776-beb4-d5a5d012be63 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:06.222856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:06.236224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:06.236918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.237204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.237478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.239811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:06.241252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.241938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.242613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.245786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:06.247674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b24791-a6ea-448e-8db8-2bbd9fdf8a98 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:06.250131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 138/272] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:06.250824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:06.252129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3300bf-0f59-43b5-a828-831a025f78f4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.252727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3300bf-0f59-43b5-a828-831a025f78f4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.253547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3300bf-0f59-43b5-a828-831a025f78f4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.256904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 139/273] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:06.260053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:06.261778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:06.263944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 135/274] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:06.265757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.265757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.266320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.269858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:06.286507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:06.287755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:06.415461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 140/275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:06.416260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:06.492135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4041-1cc5-4f55-bb89-d7ffe2ef1cf0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:06.516598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:06.556267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:06.557310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.559026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.559538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.560868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:06.561431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:06.563135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:06.570957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 136/276] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/role_assignments?user.id=aa727e0adb8c4cd5bcb94480aa8d8bdc&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:06.572346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:06.617933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b50f1-6d48-4d83-b0a8-ca41c4719f99 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:06.634350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:06.719524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804318cc-2b53-4d2b-ae52-8381ec8d5311 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:06.775549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:06.778911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.787885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.789208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.791116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:06.791917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:06.795727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:06.825747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 141/277] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:06.830468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:06.890742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:06.890742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:06.890742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:06.891250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:06.898212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:06.899763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:06.905808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 137/278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:06.906681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.032127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602f3d-9fbb-49ab-862c-5ce846d78de0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.060554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:07.069153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbc2-904d-4e83-95c9-36e3ab9e1f34 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.069794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.070427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.070710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.071128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.082123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:07.088443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:07.089617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 142/279] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:07.090496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.098756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:07.110856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.111510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.111790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.112098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] PATH_INFO: `/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.127032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] RBAC: Authorizing `identity:get_user(user_id=1f9b93b11f824b1cb4a86052df0cd4c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:07.128947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc0e82-6659-4491-870c-9aded8b77a2a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:07.131203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 138/280] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:06 2022] GET /identity/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:07.132473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74816-0421-461c-b704-dc863fdedf20 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.132759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74816-0421-461c-b704-dc863fdedf20 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.133030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74816-0421-461c-b704-dc863fdedf20 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.134358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 139/281] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:07.135119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a74816-0421-461c-b704-dc863fdedf20 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.223454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14951c6-f20e-4893-9613-f4dac502b055 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.262817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.263432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.263709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.263999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.264662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:07.266110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:07.268680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a74816-0421-461c-b704-dc863fdedf20 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.290579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 143/282] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:07 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:07.291402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.331848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.332611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.332894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.333166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.333871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:07.334173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:07.335636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bf8fb-8fb5-4f8b-b505-555b02e81909 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:07.349959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 140/283] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:07.354429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.355028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.355349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.362169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:07.382602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:07.383873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:07.433534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:07.443271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b258-4986-4200-841e-cbc64f472244 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.490884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.491519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.491798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.492103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.492901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, user.id=1f9b93b11f824b1cb4a86052df0cd4c0, scope.system=all) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:07.493215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:07.494676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:07.502066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 144/284] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 12:02:07 2022] GET /identity/v3/role_assignments?user.id=1f9b93b11f824b1cb4a86052df0cd4c0&scope.system=all&role.id=0596a83a84af4342b35541050fc02f35 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:07.504507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.512256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 141/285] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:07.668772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1ce0-8879-4cd3-bb9c-fef95fac9922 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.678380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:07.721771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.722424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.722697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.722967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] PATH_INFO: `/v3/users/7cf23853bc5e4357b511d9e3a242950a` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.724236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] RBAC: Authorizing `identity:get_user(user_id=7cf23853bc5e4357b511d9e3a242950a)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:07.725827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:07.727782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 145/286] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:07 2022] GET /identity/v3/users/7cf23853bc5e4357b511d9e3a242950a => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:07.733379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.798987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:07.908133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061534-8015-44b0-acc8-a2344159d36d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:07.964799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:07.965733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:07.967180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:07.967671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:07.984692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2489-1651-4da3-85a3-7d647021d79f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:08.054661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:08.056191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:08.056698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:08.057171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:08.067998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:08.099768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:08.117976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:08.118922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:08.119733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:08.124164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 146/287] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:08.143566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:08.217377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:08.219895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:08.248388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:08.361833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b59a-c66e-46f5-9199-90bc5d5bb43d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:08.427279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:08.429043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:08.429498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:08.429945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:08.431065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:08.431579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:08.434179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:08.452337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 147/288] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:08.463758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:08.529761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 142/289] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:08.535468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:08.618601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:08.675102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c1c6-70b5-440e-aa5d-dce1bc6cba2e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:08.740076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:08.741309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:08.741893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:08.742459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:08.744625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:08.747740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:08.751409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 143/290] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:08 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:08.761644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:08.775776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:08.794232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4901e6-d2f3-41f1-af92-061d892e49d5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:08.893059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88e0e-c546-4cf8-a49e-71b65454cd76 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:08.917314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:08.918240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:08.918687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:08.919113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] PATH_INFO: `/v3/users/4071b53de7e940738ac5a20b1e41610b` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:08.924849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] RBAC: Authorizing `identity:get_user(user_id=4071b53de7e940738ac5a20b1e41610b)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:08.926591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:08.929093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 148/291] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:08 2022] GET /identity/v3/users/4071b53de7e940738ac5a20b1e41610b => generated 297 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:08.949043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:08.949265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:08.950015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:08.950505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:08.950963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:08.951934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=7cf23853bc5e4357b511d9e3a242950a) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:08.952487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:08.954175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:08.962001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 144/292] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:08 2022] GET /identity/v3/role_assignments?user.id=7cf23853bc5e4357b511d9e3a242950a&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=0596a83a84af4342b35541050fc02f35 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:08.965825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:09.156582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24cd6e-16d9-4e8e-9e88-2aee9fe86d5f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:09.211391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:09.212064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:09.212347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:09.212620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:09.214420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:09.215879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd90b6-28f7-41a6-81a0-c4c751463304 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:09.217965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 149/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:08 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:09.226852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:09.441463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74939-cecb-44dc-a9c1-20914d9f8a62 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:09.511669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:09.512831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:09.513320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:09.513785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/users/4071b53de7e940738ac5a20b1e41610b/roles/bfc61d67e6b5440684bbe466e358a8ab` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:09.517278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, user_id=4071b53de7e940738ac5a20b1e41610b, role_id=bfc61d67e6b5440684bbe466e358a8ab)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:09.520117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eac3df-186c-4a96-b156-b054a1301c8a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:09.544694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 145/294] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:09 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/users/4071b53de7e940738ac5a20b1e41610b/roles/bfc61d67e6b5440684bbe466e358a8ab => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:10.011905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c039-f186-4a01-b266-ca010bba06e1 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.012611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c039-f186-4a01-b266-ca010bba06e1 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.013129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c039-f186-4a01-b266-ca010bba06e1 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.014992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 150/295] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:10.020717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8a02-e582-4049-9a6c-b395f047af57 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.021285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8a02-e582-4049-9a6c-b395f047af57 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.021775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8a02-e582-4049-9a6c-b395f047af57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.041716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c12a8a02-e582-4049-9a6c-b395f047af57 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:10.043261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c12a8a02-e582-4049-9a6c-b395f047af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:10.104215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:10.116926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 146/296] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:10.366368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e331-8ff6-4d30-8acc-6cdb561a33de None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.367376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e331-8ff6-4d30-8acc-6cdb561a33de None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.367850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e331-8ff6-4d30-8acc-6cdb561a33de None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.369806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 151/297] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:10.375786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb67c-3612-4813-891b-11f82a462ae5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.376735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb67c-3612-4813-891b-11f82a462ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.377228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb67c-3612-4813-891b-11f82a462ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.397589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7dddb67c-3612-4813-891b-11f82a462ae5 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:10.399116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7dddb67c-3612-4813-891b-11f82a462ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:10.403891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4e331-8ff6-4d30-8acc-6cdb561a33de None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:10.447584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:10.502963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 147/298] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:10.534675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4e331-8ff6-4d30-8acc-6cdb561a33de None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:10.559524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0840-97ba-4992-82a5-71d80043375b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.560215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0840-97ba-4992-82a5-71d80043375b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.560702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0840-97ba-4992-82a5-71d80043375b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.562543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 148/299] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:10.568149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.568709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.569713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.574791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:10.575433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.575760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.576068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.588711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:10.591509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:10.592974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:10.594322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:10.595222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:10.596063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 152/300] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:10.601327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:10.681666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 149/301] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:10.734601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:10.744372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbc48-daa7-4e68-8bc3-e1c01501b287 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:10.781433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:10.782085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:10.782363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:10.782628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:10.783294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:10.783590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:10.785057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:10.793069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:10.794814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 153/302] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:10.801485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:10.865495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:10.958314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b420-0958-4497-bbff-0177d748618d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:10.963799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1943b-4d45-4a34-8dd4-9ac698dca6da None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:10.999442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.000120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.000396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.000905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] PATH_INFO: `/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.001824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1f9b93b11f824b1cb4a86052df0cd4c0)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.003243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.005357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 154/303] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:10 2022] GET /identity/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:11.005928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.013938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.014596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.014876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.015199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.028110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:11.033175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:11.036560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 150/304] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:11.037339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.039887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:11.137512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ab67d-5a4c-4cdb-8280-b30f4980a4d7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.172668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f9ad-878d-43a8-a986-7012ec544e25 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.187486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:11.189234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.190004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.190391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.190739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.191989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.193450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.195747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 155/305] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:11.196379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.230065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.231079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.231573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.231913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] PATH_INFO: `/v3/system/users/1f9b93b11f824b1cb4a86052df0cd4c0/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.233446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f9b93b11f824b1cb4a86052df0cd4c0, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.234838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.255993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 151/306] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Sep 13 12:02:11 2022] PUT /identity/v3/system/users/1f9b93b11f824b1cb4a86052df0cd4c0/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:11.255993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.337498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:11.352299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dfb55-6227-44e5-8314-9e2020cb0732 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.409163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.409849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.410286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.410570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.411266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:11.411599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.413723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.423800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 156/307] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:11.430306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.432014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb31c-5062-45b5-9f6c-adfd0b8639d6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.482770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.484042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.484552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.485014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] PATH_INFO: `/v3/groups` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.485748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.488530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.514024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 152/308] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Sep 13 12:02:11 2022] POST /identity/v3/groups => generated 229 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:11.586687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5201ef9-d673-4a3b-b1c1-cf13559857b1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.630495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.631191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.631572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.631871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] PATH_INFO: `/v3/users/29a703d7e2274831afcf09030f39a6c3` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.650212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=29a703d7e2274831afcf09030f39a6c3)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.651727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7b15-4d75-4616-90ac-441d1b2ba9c5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.654062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 157/309] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:11 2022] GET /identity/v3/users/29a703d7e2274831afcf09030f39a6c3 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:11.664014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:11.707258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:11.782798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2e87-fd2e-48c1-8a6c-28bce1171142 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:11.820125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:11.820733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:11.821108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:11.821381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:11.822106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, user.id=29a703d7e2274831afcf09030f39a6c3, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:11.822408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:11.823856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac4b40-cafa-4ab2-a41f-51bf836c8c9c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:11.829505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 153/310] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 12:02:11 2022] GET /identity/v3/role_assignments?user.id=29a703d7e2274831afcf09030f39a6c3&scope.system=all&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:12.063368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf9de-87f5-43ef-9f04-07e338cad6ee None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:12.063368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf9de-87f5-43ef-9f04-07e338cad6ee None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:12.063368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf9de-87f5-43ef-9f04-07e338cad6ee None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:12.064017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 158/311] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:12.070348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:12.070923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:12.071408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:12.096261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:12.097832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:12.187500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 154/312] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:12.478366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cf9de-87f5-43ef-9f04-07e338cad6ee None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:12.494672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:12.603643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cf9de-87f5-43ef-9f04-07e338cad6ee None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:12.641663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:12.642362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:12.642644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:12.642918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:12.654942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:12.660240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:12.661165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:12.662132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 159/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:12.669256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:12.701510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:12.780705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817505f5-46da-4d58-ac95-ce0048e9ab3b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:12.816476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:12.817105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:12.817385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:12.817642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:12.818320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:12.818618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:12.820649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:12.830723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 155/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:12.840774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:12.920062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:12.953652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aea1f-f841-477a-bddc-1176bdb5d50e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:12.992070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:12.992724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:12.993002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:12.993423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] PATH_INFO: `/v3/users/4071b53de7e940738ac5a20b1e41610b` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:12.994632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] RBAC: Authorizing `identity:get_user(user_id=4071b53de7e940738ac5a20b1e41610b)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:12.996104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:12.998109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 160/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:12 2022] GET /identity/v3/users/4071b53de7e940738ac5a20b1e41610b => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:13.003646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:13.115060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:13.125476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8752fd-cf5a-4774-a538-ad31b854a859 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:13.165244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:13.165244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:13.165244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:13.165244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:13.256550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:13.258609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:13.357262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:13.364651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 156/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:13.371168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:13.481723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209fe8-e4b1-4bd5-b07b-98c952fa0258 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:13.527555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:13.528291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:13.528570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:13.528846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:13.530080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:13.531557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4414b2-880c-4503-bcde-2595d130a4d2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:13.533762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 161/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:13 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:13.540175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:13.623597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a44d4-a7d1-44bf-a96e-524346b15074 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:13.623912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a44d4-a7d1-44bf-a96e-524346b15074 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:13.624104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a44d4-a7d1-44bf-a96e-524346b15074 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:13.625493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 162/318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:13.631623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:13.631978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:13.632252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:13.645439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:13.652109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:13.653439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:13.666766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f0d5-211e-4907-b2a2-c0763378fb7c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:13.728943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:13.729575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:13.729827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:13.730098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:13.730826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, scope.project.id=c459f29bf8a14ae380f537681d69d366, user.id=4071b53de7e940738ac5a20b1e41610b) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:13.731130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:13.732617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80f129-adb7-43cb-9467-6cb5147a4702 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:13.740139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 163/319] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:13.741090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 157/320] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:13 2022] GET /identity/v3/role_assignments?user.id=4071b53de7e940738ac5a20b1e41610b&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:14.005157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.145511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a491-5ca9-4a96-b78d-4dbb4625f516 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.197242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.197932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.198296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.198572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.201865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:14.212208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f375e-089b-401c-8658-773e178bdbd7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.212475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f375e-089b-401c-8658-773e178bdbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.212763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f375e-089b-401c-8658-773e178bdbd7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.214370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 158/321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:14.217011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:14.219943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002379cf-412c-4c5e-ab17-98f35b437594 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.220301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002379cf-412c-4c5e-ab17-98f35b437594 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.220568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002379cf-412c-4c5e-ab17-98f35b437594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:14.221972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:14.223331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:14.224154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 164/322] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:14.231067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.244668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-002379cf-412c-4c5e-ab17-98f35b437594 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:14.245868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-002379cf-412c-4c5e-ab17-98f35b437594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:14.323565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:14.347477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 159/323] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:14.349063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2742c-abbf-4c80-9bcd-37d0fe61e3c4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.349348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2742c-abbf-4c80-9bcd-37d0fe61e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.349624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2742c-abbf-4c80-9bcd-37d0fe61e3c4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.351415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 160/324] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:14.357895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.358177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.358448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.378371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:14.379595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:14.380978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23f8df-05d2-4295-bdc0-ca28de4ab9cc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.425769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.426385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.427075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.427354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.428164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:14.428421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:14.430376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:14.440511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 165/325] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:14.446191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.499999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 161/326] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:14.538868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:14.614124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363603af-78c7-47f2-a0fc-4149aa9b1389 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.625713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.661506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.662177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.662444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.662719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] PATH_INFO: `/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.664526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] RBAC: Authorizing `identity:get_user(user_id=1f9b93b11f824b1cb4a86052df0cd4c0)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:14.665973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:14.667618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 166/327] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/users/1f9b93b11f824b1cb4a86052df0cd4c0 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:14.676888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.765278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba74ef1-dddf-41a6-a0ae-2b06bb842306 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.782402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:14.804470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.805122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.805387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.805648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.806779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:14.808265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:14.810070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 162/328] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:14.810675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.840304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64a5b8-07e8-41b2-828d-35b1b21e8439 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.873878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:14.883807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.884661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.885075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.885408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:14.886522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] RBAC: Adding query filter params (role.id=0596a83a84af4342b35541050fc02f35, user.id=1f9b93b11f824b1cb4a86052df0cd4c0, scope.system=all) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:14.886888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:14.888601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:14.902174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 167/329] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/role_assignments?user.id=1f9b93b11f824b1cb4a86052df0cd4c0&scope.system=all&role.id=0596a83a84af4342b35541050fc02f35 => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:14.903014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:14.945267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3fe1-c887-4c8f-aea2-378731c4b774 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:14.991912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:14.992788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:14.993239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:14.993665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:15.010902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:15.019810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:15.020993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:15.022681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 163/330] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:15.030498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:15.084409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5927-bb1a-4c64-b642-06dd96123021 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:15.111170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:15.135344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:15.135892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:15.136200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:15.136499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] PATH_INFO: `/v3/groups` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:15.137142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:15.139172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:15.164531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 168/331] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Sep 13 12:02:14 2022] POST /identity/v3/groups => generated 226 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:15.206911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025146b2-99d4-4dd9-a82a-46a42c53cf53 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:15.256432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:15.257057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:15.257872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:15.258140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:15.258837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:15.259135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:15.260768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:15.270498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 164/332] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:15.276939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:15.327460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:15.390200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472228-1646-4e40-968d-5e9498609e0e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:15.425514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:15.426153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:15.426426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:15.426692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] PATH_INFO: `/v3/users/29a703d7e2274831afcf09030f39a6c3` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:15.427816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] RBAC: Authorizing `identity:get_user(user_id=29a703d7e2274831afcf09030f39a6c3)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:15.430097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45a8d-1ed5-4fe2-ac06-c606243518cd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:15.431507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 169/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:15 2022] GET /identity/v3/users/29a703d7e2274831afcf09030f39a6c3 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:15.437334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:15.552853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f472-7e90-46f5-90b8-92b3a2442050 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:15.555811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:15.591108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:15.591755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:15.592072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:15.592319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] PATH_INFO: `/v3/system/users/29a703d7e2274831afcf09030f39a6c3/roles/bfc61d67e6b5440684bbe466e358a8ab` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:15.593743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29a703d7e2274831afcf09030f39a6c3, role_id=bfc61d67e6b5440684bbe466e358a8ab)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:15.595122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e4fd-bbac-413f-985a-a6d84605d4af None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:15.603666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 165/334] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Sep 13 12:02:15 2022] PUT /identity/v3/system/users/29a703d7e2274831afcf09030f39a6c3/roles/bfc61d67e6b5440684bbe466e358a8ab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:17.887797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bbf2-ba58-4417-81de-47ccc7953084 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:17.888574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bbf2-ba58-4417-81de-47ccc7953084 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:17.888574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bbf2-ba58-4417-81de-47ccc7953084 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:17.890022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 170/335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:17.895601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c069-5e98-4815-acdf-9368c4fd5d49 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:17.896313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c069-5e98-4815-acdf-9368c4fd5d49 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:17.896313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c069-5e98-4815-acdf-9368c4fd5d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:17.924451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e675c069-5e98-4815-acdf-9368c4fd5d49 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:17.925658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e675c069-5e98-4815-acdf-9368c4fd5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:18.019796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 166/336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:18.498998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e83bc-9162-457a-8aba-c5ea5be4ce4e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.499187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e83bc-9162-457a-8aba-c5ea5be4ce4e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.499452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e83bc-9162-457a-8aba-c5ea5be4ce4e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.501379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 171/337] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:18.507540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.507900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.508745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.532243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:18.533452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:18.575506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8acf-cb46-408a-b4a8-3dfc8f2fb140 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.575506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8acf-cb46-408a-b4a8-3dfc8f2fb140 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.575506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b8acf-cb46-408a-b4a8-3dfc8f2fb140 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.575506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 172/338] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:18.582553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.583148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.583651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.605968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:18.607535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:18.638612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 167/339] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:18.639501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:18.682259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:18.737690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 173/340] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:18.829855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72a64-ab22-4c91-b1f4-e2ff020f2f80 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:18.876680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:18.877330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.877603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.877880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.894040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6aae115e-407b-4b67-8663-9f3ae2c583bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:18.899086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:18.900676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:18.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 168/341] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:18.908465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:18.958773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bd71-8f9a-4c9a-8943-1ee68c5b3803 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.959189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bd71-8f9a-4c9a-8943-1ee68c5b3803 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.959326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bd71-8f9a-4c9a-8943-1ee68c5b3803 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:18.960704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 169/342] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:18.972358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:18.975923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:18.976275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:18.976501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.019353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:19.020608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:19.054633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cadf-42a1-4cb4-90c8-5083afa8170e None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.102680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.103255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.103546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.103807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.104534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:19.104836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:19.106223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:19.125901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 174/343] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:19.132209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.156054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 170/344] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:19.171368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.203893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:19.371134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aaccb-aa18-42e8-835f-4c3658cd5650 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.377304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:19.381504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ffe0-5016-4af6-a4c0-e6957011df0d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.441540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.442974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.444057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.445066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.453482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.454934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.455564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.456384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.483537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:19.488986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:19.489941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:19.490712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:19.493441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 171/345] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:19.494552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.568269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:19.570076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:19.615486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:19.654961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71978-9545-4093-9186-dc22d331a522 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.702988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.703629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.703914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.704214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.720975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:19.726545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:19.728148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:19.728942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 172/346] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:19.730102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.744318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 175/347] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:19.745261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.751930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:19.894189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66219e7-b595-4b52-9e16-314773c83b40 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.907056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b1bfa-3a5a-450f-8cc9-3f9914a8f5fc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:19.953756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.954417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.954527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:19.954713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.954934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.955035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.955306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.955582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.955674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:19.955992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:19.957406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89586a7-c8f0-4937-b86a-8331a1b5e4c2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:19.969051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 176/348] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:19.970199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2686db-5d30-4db4-8ade-a671ac6738b8 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:19.970482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2686db-5d30-4db4-8ade-a671ac6738b8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:19.970785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2686db-5d30-4db4-8ade-a671ac6738b8 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:19.972129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 177/349] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:19.972866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2686db-5d30-4db4-8ade-a671ac6738b8 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:19.978207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:19.980315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:19.988428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:19.989388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 173/350] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:19.997180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.095609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:20.163381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593bae-b092-4768-b798-e0c73fcaec47 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.175208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2686db-5d30-4db4-8ade-a671ac6738b8 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.211871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.213553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.213553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.214889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.217172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:20.217667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:20.219620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 174/351] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:20.220225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.231637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.232322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.232598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.232865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.233543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:20.233894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:20.235204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa615-6345-4b61-9949-64abc370c3ab None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:20.249797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 178/352] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:20.253071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.253071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.253071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.277677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:20.278955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:20.346338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:20.406249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 179/353] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:20.406917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.407023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc58c-7d08-434b-b6da-a8e5051783df None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.482300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.483457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.483944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.484455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.490478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:20.573212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a64ef-9acd-4b5a-84fc-ac10123c42fe None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.634240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:20.637447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:20.639772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.640779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.641227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.641635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.642603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:20.643049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:20.645003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:20.662616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 180/354] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:20.662616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.736822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:20.788676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 175/355] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:20.789898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.830993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4cb5-3d4a-4c46-b1c1-2af9248cb98e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.860743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:20.884901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.885558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.885839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.886112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.894326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:20.895809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6032c00-21dd-4363-b330-35c406d43f4a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:20.897935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 181/356] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:20 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:20.899378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4d4b-025a-47cc-b530-32714d33d689 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.899378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4d4b-025a-47cc-b530-32714d33d689 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.899378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4d4b-025a-47cc-b530-32714d33d689 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:20.902964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 182/357] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:20.902964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4d4b-025a-47cc-b530-32714d33d689 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:20.943523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9ff1-d33e-42df-9789-26e67c506f66 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:20.997763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:20.999053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:20.999513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:20.999991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] PATH_INFO: `/v3/users/29a703d7e2274831afcf09030f39a6c3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.001981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] RBAC: Authorizing `identity:get_user(user_id=29a703d7e2274831afcf09030f39a6c3)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.004410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.007433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 176/358] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:02:20 2022] GET /identity/v3/users/29a703d7e2274831afcf09030f39a6c3 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:21.011408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.048428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4d4b-025a-47cc-b530-32714d33d689 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.058693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:21.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.094437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.094710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.094985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.150943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cca7-8ec5-4a81-a3ea-b03be31a6f21 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.181233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:21.206094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.206747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.207023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.207293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.211066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.213189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.231444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:21.236788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:21.238030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 177/359] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:21.239388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.372272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 183/360] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:21.374045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.380371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:21.394665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15d15f-662d-4a63-80f3-2c394257ff0a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.455247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.455925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.456284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.456578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.457843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.459355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b991f2-365d-4383-a6c2-2ef2753a3d56 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.461409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 178/361] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:21.463239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.463490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.463758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.486055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:21.487409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:21.504938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:21.526486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727f17-1e8b-4331-8efd-5fc7cfc591c2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.578443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.578443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.578443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.578443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.579026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=6f59e478e01549da910641dbb52ad42d) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:21.579026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.581627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.588299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 184/362] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=0596a83a84af4342b35541050fc02f35 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:21.589160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.602074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 179/363] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:21.603657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.767329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:21.789431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b092b1-ea5e-4d76-9ff4-34c0a0320904 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.790502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e3ca-e1cd-4e3b-a4ca-90ad2c7bf1e7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:21.838662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.839447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.839825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.840328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.841340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:21.841749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.841952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:21.842842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:21.843164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:21.843443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:21.843925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.844425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] RBAC: Adding query filter params (role.id=bfc61d67e6b5440684bbe466e358a8ab, user.id=29a703d7e2274831afcf09030f39a6c3, scope.system=all) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:21.844821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:21.846470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:21.859936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 180/364] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:21.861070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.863666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 185/365] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/role_assignments?user.id=29a703d7e2274831afcf09030f39a6c3&scope.system=all&role.id=bfc61d67e6b5440684bbe466e358a8ab => generated 510 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:21.864718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:21.880338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.044916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42371a-c059-47ae-a4af-778c7916edde None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.069804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f5b7-da72-41db-9fdd-a8a6179eee25 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.137998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.139633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.141548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.141548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.144446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.148237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.148486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.148619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.148619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.148619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.148990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.151530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 181/366] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:22.151530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.156425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.157037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 186/367] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:21 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:22.158054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.199778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.271620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.305095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159cc1-d421-47f1-8211-ecdf11a82b83 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.326281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548bd2-f5af-4293-a169-5f548e60e2d9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.357587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.358237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.358518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.358793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.374317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:22.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:22.382267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:22.383034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 187/368] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:22.383855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.389277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.390219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.390721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.391187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.512319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.513890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.541233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7757a5-6d11-4bc7-835b-8eb2e1f891bd None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.547109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.581973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.582907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.583206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.583481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.584521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=6f59e478e01549da910641dbb52ad42d) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:22.585024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.587258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.589565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.605144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 188/369] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:22.606861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.704536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 182/370] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:22.705858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.825977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1587c4-c879-4edd-89d1-2a782760ccb3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.870272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.871720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.872470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.873180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.875550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.878674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.882673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 189/371] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:22.884585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:22.911868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aca328-6205-4408-b168-d14c2e234f68 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:22.940547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:22.957286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:22.958588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:22.959096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:22.959599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:22.960937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:22.961496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:22.965319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:22.984502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 183/372] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:22.986304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:23.013613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:23.084371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c6d6-77a8-431d-b26f-f0a69be98ac7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:23.153663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:23.155111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:23.155828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:23.160197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:23.169598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:23.172803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:23.176802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 190/373] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:23.178714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:23.191445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbece5-0c36-4e9e-8729-2ba8a36a3c86 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:23.238512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:23.239599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:23.239884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:23.240222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:23.240959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=c459f29bf8a14ae380f537681d69d366) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:23.241271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:23.243127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:23.250595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 184/374] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:22 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=0596a83a84af4342b35541050fc02f35 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:23.251299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:23.406149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:23.462385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ac78-d260-4aea-9a36-019ee8363be2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:23.532359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:23.532359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:23.532780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:23.532909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:23.552477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:23.554606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891641-6a99-4acf-a702-ddd9896f983d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:23.633105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:23.635363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:23.636190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:23.636961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:23.640138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:23.643833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:23.648407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 185/375] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:23 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:23.660345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:23.709184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:23.710684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33e64f-5895-4d91-a4d9-7584a65a8164 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:23.804629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11776d3c-2a5a-4d2b-b399-82792c2cc467 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:23.825049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:23.846692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:23.847317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:23.847596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:23.847877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:23.848801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=c459f29bf8a14ae380f537681d69d366) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:23.849115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:23.850724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:23.858057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 186/376] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:23 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:24.035199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 191/377] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:24.044791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:24.129514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a3de-87ba-41b5-b1f6-fb28fbd0717a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:24.130798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a3de-87ba-41b5-b1f6-fb28fbd0717a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:24.131499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a3de-87ba-41b5-b1f6-fb28fbd0717a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:24.135008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 192/378] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:24.142711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:24.143539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:24.144580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:24.209996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:24.223151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:24.291514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a5e6-9f94-45d5-a772-580d4b584f64 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:24.308373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:24.374078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:24.375191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:24.375690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:24.376274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] PATH_INFO: `/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:24.380337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5edf9a0e494edcae6ef0e92c3e80ed)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:24.382642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:24.386411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 187/379] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:24 2022] GET /identity/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed => generated 344 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:24.393412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:24.403501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 193/380] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:24.497899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:24.589181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f5da-eecb-4e45-960e-fee3496be576 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:24.641707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:24.642773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:24.643263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:24.643764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] PATH_INFO: `/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:24.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] RBAC: Authorizing `identity:get_group(group_id=5f9a37ba6cc44eda95c1d4fd4934e15e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:24.657560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:24.666062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 188/381] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:24 2022] GET /identity/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:24.677787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:24.887787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f0d6-9499-4933-9599-c9dce4c66587 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:24.963254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:24.963891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:24.964347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:24.964811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:24.966186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] RBAC: Adding query filter params (group.id=5f9a37ba6cc44eda95c1d4fd4934e15e, role.id=83fb245122344892b0377532854af000, scope.project.id=eb5edf9a0e494edcae6ef0e92c3e80ed) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:24.966479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:24.967676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:24.969147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:24.977847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 194/382] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:24 2022] GET /identity/v3/role_assignments?group.id=5f9a37ba6cc44eda95c1d4fd4934e15e&scope.project.id=eb5edf9a0e494edcae6ef0e92c3e80ed&role.id=83fb245122344892b0377532854af000 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:25.156296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b3e2-c7df-4ff9-878d-48d19ff2664d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:25.183946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:25.223055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:25.223743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:25.224049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:25.224327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:25.238906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:25.247482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:25.248641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:25.254653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 189/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:25.260045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:25.332694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:25.473219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a2ea-b671-40d5-8800-9fa2c0aac746 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:25.562408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:25.563465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:25.563949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:25.564460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:25.565685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:25.566177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:25.568336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:25.587086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 195/384] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:25.593134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:25.782869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011142d8-9e7e-4469-998e-f27843df66af None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:25.840893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:25.841671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:25.841946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:25.842227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:25.843539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:25.845092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812fe69-34f9-4572-b07d-21c6cedc2deb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:25.847174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 190/385] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:25 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:25.855939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:26.044332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff737-8f49-45fb-9acc-6a7b37c3aea7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.044695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff737-8f49-45fb-9acc-6a7b37c3aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.044963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff737-8f49-45fb-9acc-6a7b37c3aea7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.047052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 191/386] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:26.056790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410fda5-be48-4607-9ee6-ecd42b157626 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.057285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410fda5-be48-4607-9ee6-ecd42b157626 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.057775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410fda5-be48-4607-9ee6-ecd42b157626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.075823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:26.101129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8941e-ab66-492a-97b8-bd1138b9616d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:26.114065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8410fda5-be48-4607-9ee6-ecd42b157626 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:26.116019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8410fda5-be48-4607-9ee6-ecd42b157626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:26.234059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:26.235176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.235671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.236177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.238509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:26.245885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:26.249116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 196/387] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:25 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:26.256523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:26.262352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:26.319866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 192/388] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:26.510662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a250782-ef0f-468e-b697-942852cd3e4a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:26.584175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:26.584744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.585018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.585279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/groups/25180272ee954b6fbe00073a36854b7e/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.588176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, group_id=25180272ee954b6fbe00073a36854b7e, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:26.590157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beda9b1-3dad-4529-96f3-6ced3a4f723a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:26.609616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 197/389] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 12:02:26 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/groups/25180272ee954b6fbe00073a36854b7e/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:26.658366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0492-f934-4c2e-b825-f85c6d990b83 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.659108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0492-f934-4c2e-b825-f85c6d990b83 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.659108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0492-f934-4c2e-b825-f85c6d990b83 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.661195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 193/390] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:26.668318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.668811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.669297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:26.669448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad0492-f934-4c2e-b825-f85c6d990b83 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:26.707717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:26.709839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:26.750635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:26.872205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 198/391] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:26.906781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad0492-f934-4c2e-b825-f85c6d990b83 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:26.985683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:26.987249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:26.988238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:26.988936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.010086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:27.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:27.020952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:27.021927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:27.026692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 194/392] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:27.032414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.226719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.236262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82decf7-4286-408e-8efc-6c74d08e40ce None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:27.301397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:27.320195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:27.321050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.321463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.321890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.323296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:27.323749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:27.325259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:27.341860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 199/393] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:27.348068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.369871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:27.423043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c7bd-fc2f-448d-bb6a-d245310628db None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:27.466798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb7bfb-05da-4fa8-becb-646ed1b77883 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:27.471044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:27.471805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.472215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.472584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.489523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5b776c61-f967-48c0-9c9e-869896a64866 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:27.498149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:27.499239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 195/394] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:27.506199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d996-fdaf-41f4-b3f0-b1ac1f2eddc7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.507115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d996-fdaf-41f4-b3f0-b1ac1f2eddc7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.507115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d996-fdaf-41f4-b3f0-b1ac1f2eddc7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.507115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 196/395] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:27.515511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.515802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.516090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.528668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:27.528668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.528668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.529292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.531122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:27.533495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:27.540131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 200/396] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:27.541240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.542917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:27.546191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:27.645807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:27.649422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 197/397] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:27.650636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.697552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8790fd-a815-4c34-bc41-1ca93ad3ceb1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:27.703274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:27.806401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f4ef5-0d8d-49e9-bd35-c9bfc528fca9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:27.843751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:27.845093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.845569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.846034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.847398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:27.848705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:27.849341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:27.849625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:27.849725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:27.849898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:27.850587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:27.850889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:27.852348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:27.852798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 198/398] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:27.860695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:27.872380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 201/399] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:27.880074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.011817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e19c2e-5b8a-4e6f-b3a9-8302284226e8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.027504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.045003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84759b7-6c3b-45b7-bfea-dab600873cbf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.063363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.064650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.064936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.065205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.067556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.069239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.075515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 202/400] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:27 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:28.076491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.090133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.094868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752385b-7755-4afa-8581-fc315455111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.095866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752385b-7755-4afa-8581-fc315455111b None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.096576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752385b-7755-4afa-8581-fc315455111b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.097609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752385b-7755-4afa-8581-fc315455111b None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d/groups/25180272ee954b6fbe00073a36854b7e/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.101127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752385b-7755-4afa-8581-fc315455111b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f59e478e01549da910641dbb52ad42d, group_id=25180272ee954b6fbe00073a36854b7e, role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.102849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752385b-7755-4afa-8581-fc315455111b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.124064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 199/401] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 12:02:27 2022] PUT /identity/v3/projects/6f59e478e01549da910641dbb52ad42d/groups/25180272ee954b6fbe00073a36854b7e/roles/75e15a3f70704e038e150ee93dfacae2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:28.125329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752385b-7755-4afa-8581-fc315455111b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.223335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d270-8a97-4e3f-b6ec-810ff28adf2d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.267288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.268302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.268761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.269157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.275939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752385b-7755-4afa-8581-fc315455111b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.285080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-5a089b10-7633-4a8e-93aa-4b00e34ce467 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:28.293099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:28.294068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:28.294836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 203/402] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:28.295518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5433-fca5-4a3b-bd32-d1916d0dc9e6 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.296404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5433-fca5-4a3b-bd32-d1916d0dc9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.296404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5433-fca5-4a3b-bd32-d1916d0dc9e6 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.301486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 204/403] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:28.302387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5433-fca5-4a3b-bd32-d1916d0dc9e6 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.324622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.325705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.326183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.326678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.328168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.329892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47453884-0080-4362-8021-608bb4ef1560 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.332189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 200/404] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:28.333660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.334118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.334565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.365704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:28.366906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:28.382452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.393436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.436693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5433-fca5-4a3b-bd32-d1916d0dc9e6 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.460001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 201/405] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:28.460001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.501939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.503196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.505037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.506680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.507591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:28.508639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.511142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.534947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 205/406] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:28.540567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.663024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7eeae-617c-4189-812c-e74f7c60aef9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.705172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.706099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.706374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.706639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/groups/25180272ee954b6fbe00073a36854b7e/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.709145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, group_id=25180272ee954b6fbe00073a36854b7e, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.710677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.729727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 202/407] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 12:02:28 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/groups/25180272ee954b6fbe00073a36854b7e/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:28.755821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69179ee-09ef-4366-bab8-d2ab8ba2aae8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.797683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.819356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.821750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:28.837811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.838500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.838780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.839069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:28.840250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:28.842066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:28.843634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 206/408] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:28.851171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:28.950867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5645f-00e1-49f1-987f-86734e0ffe9d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:28.992304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:28.993294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:28.993762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:28.994824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.008653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:29.015738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:29.016955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:29.017744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:29.020897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 203/409] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:29.028330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.128448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3846-118e-481b-a0b1-79141079dac3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:29.174941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:29.175588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.175863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.176180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.176619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:29.177460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:29.179165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee700-9783-4a71-b4a8-f387ed914d87 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:29.181361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 207/410] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:28 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:29.183297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e2693-c15e-408a-a8cd-032810cd5c99 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.183646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e2693-c15e-408a-a8cd-032810cd5c99 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.184011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e2693-c15e-408a-a8cd-032810cd5c99 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.189472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 208/411] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:29.189472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e2693-c15e-408a-a8cd-032810cd5c99 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.234635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382477e6-62b7-483d-81b4-718bd8db3b98 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:29.272803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:29.282154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:29.283082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.283563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.284087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.285487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:29.286004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:29.288098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1a8bd-88b9-4317-af7a-a8a9d4737bab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:29.300797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 204/412] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:29.302898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.303791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.304269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.315255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e2693-c15e-408a-a8cd-032810cd5c99 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:29.328673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:29.331140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:29.362111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:29.362784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.363061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.363390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366/groups/25180272ee954b6fbe00073a36854b7e/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.366605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] RBAC: Authorizing `identity:create_grant(project_id=c459f29bf8a14ae380f537681d69d366, group_id=25180272ee954b6fbe00073a36854b7e, role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:29.368093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:29.385307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 209/413] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 12:02:29 2022] PUT /identity/v3/projects/c459f29bf8a14ae380f537681d69d366/groups/25180272ee954b6fbe00073a36854b7e/roles/75e15a3f70704e038e150ee93dfacae2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:02:29.386176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.427430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 205/414] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:29.608460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f29272-5744-4026-9d13-53276f001e5c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:29.638036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:29.648584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:29.649460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.649933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.650399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] PATH_INFO: `/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.652121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] RBAC: Authorizing `identity:get_group(group_id=5f9a37ba6cc44eda95c1d4fd4934e15e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:29.653556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:29.655478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 210/415] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:29 2022] GET /identity/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:29.661229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.731219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:29.773507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.793539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ff537-550c-48e6-8690-ba5a9a13ef19 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:29.832208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:29.833153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:29.833427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:29.833691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] PATH_INFO: `/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:29.834830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5edf9a0e494edcae6ef0e92c3e80ed)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:29.836780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:29.839409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 206/416] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:29 2022] GET /identity/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:29.844739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:29.959288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4addf3-72ce-4fcf-8dec-bc4b4c1d90a3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:30.000397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:30.001702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:30.002381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.002680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.002933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] PATH_INFO: `/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed/groups/5f9a37ba6cc44eda95c1d4fd4934e15e/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.009627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5edf9a0e494edcae6ef0e92c3e80ed, group_id=5f9a37ba6cc44eda95c1d4fd4934e15e, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:30.011639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:30.036129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 207/417] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 12:02:29 2022] PUT /identity/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed/groups/5f9a37ba6cc44eda95c1d4fd4934e15e/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:30.045124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad2d9-95af-4a33-83ca-811215f07d9b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:30.094680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:30.095324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.095600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.095868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.109814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:30.115063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:30.116045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:30.116855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 211/418] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:30.124234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:30.283143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2e4e-f7f7-4f25-b9cd-a49297738c74 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:30.335041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:30.335653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.335925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.336231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.336895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:30.337189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:30.338603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea357c-433a-410b-bdcf-2c940b89eab3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:30.351588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 208/419] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:30.357671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:30.470647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:30.529536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e7d4-4442-4884-8a95-d76136fb9449 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:30.571709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:30.573436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.573987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.574457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.672699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:30.675014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:30.753690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:30.797662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cd77-b496-4588-8dcf-d57220be4739 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.798211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cd77-b496-4588-8dcf-d57220be4739 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.798412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cd77-b496-4588-8dcf-d57220be4739 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.800018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 209/420] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:30.813647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 212/421] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:30.816707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:30.817285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:30.817754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:30.821250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:30.853816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:30.856734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:30.933220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:30.975589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 210/422] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:31.002761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e2e1-059d-47ad-a91a-7ec6ef1d0f46 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:31.044074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:31.044888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.045161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.045430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.050973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:31.052456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:31.054522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 213/423] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:30 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:31.059754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:31.209694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8480aab-28ea-4418-aa92-9fc2450a5f0f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:31.246017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:31.246656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.246935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.247206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.248361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:31.249788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:31.251672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 211/424] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:31 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:31.257400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:31.313878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:31.425117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fdde-e891-4810-93c2-844c7e0a9a88 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:31.472647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:31.483705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:31.484838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.485347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.485800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.487118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=6f59e478e01549da910641dbb52ad42d) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:31.487629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:31.490206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916ad8-afae-415c-9eec-da4b735cb939 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:31.498936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 214/425] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:31 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=0596a83a84af4342b35541050fc02f35 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:31.590296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:31.633837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b9c-8588-4725-b28b-3841cb41a64f None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.634168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b9c-8588-4725-b28b-3841cb41a64f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.634397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b9c-8588-4725-b28b-3841cb41a64f None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.636387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 215/426] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:31.659249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.659591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.659818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.680962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c253390-b0a1-4063-a412-552a782e726b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:31.704316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:31.705660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:31.730717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:31.731357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.731631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.731897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.748241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:31.753317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:31.754422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:31.755240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 212/427] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:31.763882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:31.824888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 216/428] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:31.919622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb9c36-bc4c-4211-9192-5ef651e025ae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:31.930183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:31.968029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:31.968546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:31.968819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:31.969116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:31.969826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:31.970124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:31.971677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:31.981589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 213/429] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:31.987216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.015065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.119921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cafaf8-f324-4303-a27d-b936771ecf30 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.161857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.163763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.164300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.164737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.189013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.249112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:32.252003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d88056-7313-4fb6-8a73-bf3d6b09747e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:32.279796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.326506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9bdfa-f763-4bf2-9402-1a3e7c9b6cae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.374341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.374988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.375266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.375539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.387244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d973f605-7e90-420f-9486-1024222d1e1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:32.392364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:32.393275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 214/430] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:32.397641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101e3f-c4e3-43f1-978b-819faca4253f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.398517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101e3f-c4e3-43f1-978b-819faca4253f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.398517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101e3f-c4e3-43f1-978b-819faca4253f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.398517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 215/431] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:32.403847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03101e3f-c4e3-43f1-978b-819faca4253f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.408137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 217/432] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:32.412708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477b81-e661-4919-8704-232a99f03afa None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.412708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477b81-e661-4919-8704-232a99f03afa None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.412708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477b81-e661-4919-8704-232a99f03afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.435429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-0d477b81-e661-4919-8704-232a99f03afa None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:32.437218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-0d477b81-e661-4919-8704-232a99f03afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:32.440128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.530741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 218/433] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:32.541455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477b81-e661-4919-8704-232a99f03afa None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.552372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03101e3f-c4e3-43f1-978b-819faca4253f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.604264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.605197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.605484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.605760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.607289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.607426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:32.608445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:32.610420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:32.628159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 216/434] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:32.631192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.677101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477b81-e661-4919-8704-232a99f03afa None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.717555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.719091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.719571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.720108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] PATH_INFO: `/v3/projects/6f59e478e01549da910641dbb52ad42d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.721527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f59e478e01549da910641dbb52ad42d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:32.723179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db2c5-cd3a-4315-984b-2e29be5198f3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:32.725274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 219/435] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/projects/6f59e478e01549da910641dbb52ad42d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:32.726682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389e39-47b0-41fa-a42d-9d6884da73d8 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.727865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389e39-47b0-41fa-a42d-9d6884da73d8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.728382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389e39-47b0-41fa-a42d-9d6884da73d8 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.730198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 220/436] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:32.731170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389e39-47b0-41fa-a42d-9d6884da73d8 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:32.752171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.763608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f80bb-84e3-479c-bc94-2d1d220931da None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.802926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.803445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.803716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.804020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.843177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389e39-47b0-41fa-a42d-9d6884da73d8 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:32.857729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:32.879928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:32.880585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.880862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.881129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.881759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:32.882526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:32.883761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:32.884489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeba91-4062-4ea3-8a34-cb5a5fdc3323 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:32.886092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 221/437] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:32.887268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:32.887625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:32.888114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:32.906865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:32.908095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:32.982270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 222/438] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:32.983129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.000173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.012107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 217/439] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:02:33.013048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.105181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75728cd-122c-49cb-88c6-bacdf99bc29c None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.119165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e08cd-d172-4dd6-9c6d-3c4115399684 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.120672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.148707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.149376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.149653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.149934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.163517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:33.168078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:33.168491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:33.169431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:33.170193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 223/440] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:33.171265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.171840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.172139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.172395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.173131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=6f59e478e01549da910641dbb52ad42d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:33.173433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.175237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.183999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 218/441] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=6f59e478e01549da910641dbb52ad42d&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.192092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.275938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.306679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07502-d1e3-492b-b4c5-c0616c106664 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.336011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038896-a2b0-4713-aa16-7c4ab0b0f326 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.348878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.349523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.349796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.350060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.351704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.353139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.359539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 224/442] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.359539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.390243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.390810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.391679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.391679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.392074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:33.392379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.393922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.404215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 219/443] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.405109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.417918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.497848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6ac6b-3d55-43ec-9588-0683b067f59c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.548168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.548818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.549092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.549355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.550959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d7e0-76af-45df-9aab-dd0779dcadaa None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.562980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:33.568203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:33.572312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 225/444] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:33.573211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.578795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.607051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.608058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.608475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.608878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.610886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.612957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.617398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 220/445] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.618851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.696906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.700102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e555cb8-bc63-4aa8-a746-c6d2a91a7449 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.731665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c986950-f7ef-40fa-a50e-fdef3dd553e3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.737785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.738397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.739102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.739382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.766528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.767134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.767417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.767681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.768382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:33.768676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.770041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.778504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 221/446] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.779255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.810098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.811569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.826820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.882111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c2fc-b008-4eb1-b571-f940bc0c24a3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:33.909819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:33.914369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 226/447] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:33.915217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:33.917413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:33.918184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:33.918458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:33.918823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:33.919607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=0596a83a84af4342b35541050fc02f35, scope.project.id=c459f29bf8a14ae380f537681d69d366) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:33.919911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:33.921394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:33.927748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 222/448] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=0596a83a84af4342b35541050fc02f35 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:33.928632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.044795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9118e94-a401-4471-b715-3a692bc25d51 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.054888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecd9e2-1c87-4f95-ab2d-f52c52304b56 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.067469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:34.089391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.090182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.090846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.091124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.095270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.095913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.096233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.096586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] PATH_INFO: `/v3/projects/c459f29bf8a14ae380f537681d69d366` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.097978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] RBAC: Authorizing `identity:get_project(project_id=c459f29bf8a14ae380f537681d69d366)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.100097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.101978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 223/449] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/projects/c459f29bf8a14ae380f537681d69d366 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:34.108340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.198079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:34.200844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.202844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.252134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99c3-febd-4fc3-aff7-3ba155c934dc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.299549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.300232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.300511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.300785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] PATH_INFO: `/v3/groups/25180272ee954b6fbe00073a36854b7e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.302440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] RBAC: Authorizing `identity:get_group(group_id=25180272ee954b6fbe00073a36854b7e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.304114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.311317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 224/450] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:34 2022] GET /identity/v3/groups/25180272ee954b6fbe00073a36854b7e => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:34.311805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.349288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 227/451] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:34.355925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.372294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:34.427737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5cf-a4d8-4d9e-ac77-0918cae841bb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.458945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:34.462681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416a49d-3616-494c-9c53-c4a9c5e0bbc9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.464576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.465285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.465564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.465834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.466575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] RBAC: Adding query filter params (group.id=25180272ee954b6fbe00073a36854b7e, role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=c459f29bf8a14ae380f537681d69d366) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:34.466878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.468342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.474409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 225/452] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:34 2022] GET /identity/v3/role_assignments?group.id=25180272ee954b6fbe00073a36854b7e&scope.project.id=c459f29bf8a14ae380f537681d69d366&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:34.501985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.502893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.503170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.503430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] PATH_INFO: `/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.505212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] RBAC: Authorizing `identity:get_project(project_id=eb5edf9a0e494edcae6ef0e92c3e80ed)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.506669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.508415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 228/453] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:02:34 2022] GET /identity/v3/projects/eb5edf9a0e494edcae6ef0e92c3e80ed => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:34.514539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.626161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa736-5ff2-4e7c-967a-3ac5d42122e4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.638510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:34.662638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.663260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.663536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.663805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] PATH_INFO: `/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.664952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] RBAC: Authorizing `identity:get_group(group_id=5f9a37ba6cc44eda95c1d4fd4934e15e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.666376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091af33b-d982-4e92-8dcf-0de328131455 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.667945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 226/454] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 12:02:34 2022] GET /identity/v3/groups/5f9a37ba6cc44eda95c1d4fd4934e15e => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:34.674136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:34.778373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411855e-d200-473c-88fc-79d534b8bf9e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:34.813704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:34.814343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:34.814616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:34.814881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:34.816281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] RBAC: Adding query filter params (group.id=5f9a37ba6cc44eda95c1d4fd4934e15e, role.id=83fb245122344892b0377532854af000, scope.project.id=eb5edf9a0e494edcae6ef0e92c3e80ed) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:34.816588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:34.818010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bc66-2211-4632-a5ec-dc76dacc047e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:34.824324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 229/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 12:02:34 2022] GET /identity/v3/role_assignments?group.id=5f9a37ba6cc44eda95c1d4fd4934e15e&scope.project.id=eb5edf9a0e494edcae6ef0e92c3e80ed&role.id=83fb245122344892b0377532854af000 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:37.508431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5d68-729a-40f0-9f86-d0f6eff299f1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:37.509912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5d68-729a-40f0-9f86-d0f6eff299f1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:37.510669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5d68-729a-40f0-9f86-d0f6eff299f1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:37.514178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 227/456] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:37.520736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a106-af46-4b0c-8834-af8b11cdef48 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:37.521453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a106-af46-4b0c-8834-af8b11cdef48 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:37.521622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a106-af46-4b0c-8834-af8b11cdef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:37.561554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-d6f3a106-af46-4b0c-8834-af8b11cdef48 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:37.567271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d6f3a106-af46-4b0c-8834-af8b11cdef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:37.631100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:37.733936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 230/457] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:38.069289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a7fd-92da-4c59-8bcb-9dbe81c028f4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.070292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a7fd-92da-4c59-8bcb-9dbe81c028f4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.071031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a7fd-92da-4c59-8bcb-9dbe81c028f4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.074610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 228/458] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:38.081114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.081585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.082059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.120011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:38.121773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:38.280289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389a7fd-92da-4c59-8bcb-9dbe81c028f4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:38.282662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 231/459] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:38.461772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389a7fd-92da-4c59-8bcb-9dbe81c028f4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:38.512698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:38.513664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.513664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.513934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.530226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:38.531759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:38.555806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:38.557529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:38.559209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:38.559209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:38.559209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:38.564290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 229/460] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:38.569862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:38.626548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:38.710064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:38.773419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:38.796006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee059f-6889-4203-9eb5-cf79cc1d26e4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:38.888701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:38.890635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.891112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.891584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.895075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16609a9-f7d5-4bd5-a3fa-72473525019e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:38.896723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:38.897258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:38.899889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e6fdd-df8d-4b45-8bc3-1fac90969dba None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:38.924836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 232/461] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:38.926351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5078-cac6-419e-9edd-e3abaa29eebd None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.926639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5078-cac6-419e-9edd-e3abaa29eebd None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.926910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5078-cac6-419e-9edd-e3abaa29eebd None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.932911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 233/462] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:38.934197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5078-cac6-419e-9edd-e3abaa29eebd None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:38.945075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:38.945752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.946038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.946313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:38.960508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:38.962199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-883ef17d-875c-4eed-a2d3-b1bab7e992bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:38.979835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:38.981430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 230/463] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:38.982783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:38.983220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.009947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:39.011318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:39.098366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5078-cac6-419e-9edd-e3abaa29eebd None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:39.107983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 231/464] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:39.107983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:39.120560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:39.169925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:39.171231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.171660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.172258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.173195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:39.174774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:39.223057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 234/465] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:38 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:02:39.231527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc784969-79ad-413f-ab97-6d9a7615f26f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:39.272110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:39.272821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.273102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.273375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.274106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:39.274412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:39.275846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225b42-ba69-4427-a43a-7580e59b96ff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:39.290534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 232/466] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:39.297374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:39.318699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:39.455350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c13ed-ea20-4db6-9368-5553eeb2da56 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:39.495991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:39.496625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.496901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.497170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.497822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:39.499245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467e80-a2eb-41d8-b121-e2a3bd086e0a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:39.523608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 235/467] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:39 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:39.551184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a176cf-d6ed-41dd-8088-c3b0c34dd44b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.551184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a176cf-d6ed-41dd-8088-c3b0c34dd44b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.551184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a176cf-d6ed-41dd-8088-c3b0c34dd44b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.552331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 233/468] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:39.559667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1d3e-2c31-4356-a6cc-d785605d18d3 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.560425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1d3e-2c31-4356-a6cc-d785605d18d3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.561031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1d3e-2c31-4356-a6cc-d785605d18d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.588215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-584c1d3e-2c31-4356-a6cc-d785605d18d3 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:39.590465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-584c1d3e-2c31-4356-a6cc-d785605d18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:39.593902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a176cf-d6ed-41dd-8088-c3b0c34dd44b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:39.683542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:39.721097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a176cf-d6ed-41dd-8088-c3b0c34dd44b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:39.722431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:39.742693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 236/469] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:39.744892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267450-6d63-4059-bb55-4c93a867996b None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.745351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267450-6d63-4059-bb55-4c93a867996b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.745787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267450-6d63-4059-bb55-4c93a867996b None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.748674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 237/470] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:39.757735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.758313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.758795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.769278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:39.769960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.770235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.770511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.783864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:39.785370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:39.798617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:39.800219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:39.802000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:39.802924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:39.803789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:39.803789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:39.803789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:39.803789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 234/471] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:39.810410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:39.919764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 238/472] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:39.931107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb78c5-c7cb-46ae-8f3f-fb80bf1c4e4e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:39.974357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:39.991515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:39.992169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:39.992453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:39.992722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:39.993366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:39.993662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:39.995023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:40.009667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 235/473] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:40.020613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.142912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d98da-93a2-41f0-9e02-29fe89410e6e None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:40.189238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:40.196852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.199443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:40.200320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:40.200780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:40.201253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:40.202101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:40.204197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:40.241531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 239/474] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:40 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:40.247858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.486157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50a36-19aa-4efb-928c-05a150143074 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:40.503124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361190a-5cb9-4877-90ea-ec5b9c7ebd03 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:40.542861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:40.543584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:40.543861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:40.544156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:40.544956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:40.546454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:40.548563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:40.549408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:40.549933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:40.550501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:40.555974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.sql.core [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:02:40.555974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 12:02:40.555974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [parameters: {'id': 'dfa54e76a8b347ac9b803ca013f4b3fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 12:02:40.555974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81577) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:02:40.564501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:40.566267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Sep 13 12:02:40.576078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:02:40.577008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application yield resource Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise self.value Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application session.commit() Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:02:40.578147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:02:40.579182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:02:40.580131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:02:40.580954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [parameters: {'id': 'dfa54e76a8b347ac9b803ca013f4b3fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:40.584806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 12:02:40.587007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.589752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 236/475] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 12:02:40 2022] POST /identity/v3/roles => generated 144 bytes in 381 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:40.589752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:40.594913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:40.597354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:40.598393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:40.598393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:40.598393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:40.598393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 240/476] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:40.601642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.662674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:40.671269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:40.733095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a267a-4d69-42da-bda0-b135051d19b5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:40.779407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820359-9d19-4790-807f-7e7cbc54eca1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:40.820298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:40.821052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:40.821333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:40.821724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:40.826494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:40.827357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:40.827809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:40.828209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:40.829186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:40.829620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:40.837471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:40.856543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:40.863917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:40.865080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:02:40.865851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:40.868639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 241/477] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:40.868861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 237/478] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:02:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:40.874305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:40.876176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:41.044444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:41.065013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5047-c1a7-4f49-a316-1bf98ca80911 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:41.119563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cf21-84fe-4cb5-bf28-773038506f73 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:41.131400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:41.144873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:41.145537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:41.145828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:41.146086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:41.146770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:41.147071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:41.148491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc466d-9882-4ae4-b7f3-a4ee338aaa22 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:41.163134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:41.164152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:41.164643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:41.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:41.165950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:41.168320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee8597-9f08-4334-aeef-f7abed76628d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:41.180106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 242/479] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:41.201962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 238/480] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:40 2022] POST /identity/v3/users => generated 249 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:42.284639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06f70-8f41-4cbc-8654-3905ff7feb4e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:42.285149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06f70-8f41-4cbc-8654-3905ff7feb4e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:42.285261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06f70-8f41-4cbc-8654-3905ff7feb4e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:42.286920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 243/481] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:42.292345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e56d3-2c16-43c0-9c32-35aad1daf573 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:42.292821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e56d3-2c16-43c0-9c32-35aad1daf573 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:42.292901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e56d3-2c16-43c0-9c32-35aad1daf573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:42.317537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a35e56d3-2c16-43c0-9c32-35aad1daf573 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:42.319261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a35e56d3-2c16-43c0-9c32-35aad1daf573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:42.463745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 239/482] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:42.542623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2427-d849-447a-ae8f-0dd313c44d12 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:42.543295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2427-d849-447a-ae8f-0dd313c44d12 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:42.543814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2427-d849-447a-ae8f-0dd313c44d12 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:42.546074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 244/483] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:42.553292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:42.553596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:42.553847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:42.581226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:42.582655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:42.684551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 240/484] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:42.820797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2427-d849-447a-ae8f-0dd313c44d12 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:42.977696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2427-d849-447a-ae8f-0dd313c44d12 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.022191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.034158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.034807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.035092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.035363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.062649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:43.068164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:43.076199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:43.077094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:43.077897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:43.090219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 245/485] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:43.097504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.136401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.239807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6221-cb36-4627-9189-b31d2b6f0e0e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.267196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24e9ff-f0e0-4172-997c-00768832039f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.302055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.303018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.303302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.303570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.304551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:43.304886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:43.306981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f867e-c4dc-4ebb-8dd5-8a75848ab65d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:43.316959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.317604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.320070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.320070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.320347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 246/486] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:43.321550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486b07-f4d3-4e2a-8e2d-dc840759bdd4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.321895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486b07-f4d3-4e2a-8e2d-dc840759bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.322173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486b07-f4d3-4e2a-8e2d-dc840759bdd4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.323418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 247/487] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:43.325930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5486b07-f4d3-4e2a-8e2d-dc840759bdd4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.336322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0d715495-d5e0-4d4e-a366-11bb8a847222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:43.341164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:43.342048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:43.342819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:43.347479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 241/488] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:43.348873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.349161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.349436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.368953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:43.370150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:43.445840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.452000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 242/489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:43.452000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.483986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.509183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5486b07-f4d3-4e2a-8e2d-dc840759bdd4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.580658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.581728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.583387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.584075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.610175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:43.612010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:43.637544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:43.638715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:43.639754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:43.639754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:43.639754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:43.649622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 248/490] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:43.663036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.671018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7f6bd-fe1e-48b0-8106-c15c6fc53ad1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.749904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee91-db87-482a-970d-384cea90195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.750901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee91-db87-482a-970d-384cea90195a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.751404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee91-db87-482a-970d-384cea90195a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.751894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee91-db87-482a-970d-384cea90195a None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.752806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ee91-db87-482a-970d-384cea90195a None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:43.753306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ee91-db87-482a-970d-384cea90195a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:43.754908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ee91-db87-482a-970d-384cea90195a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:43.775520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 243/491] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:43.782112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee91-db87-482a-970d-384cea90195a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.841966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca182-ca9f-4806-b43a-8553b12de663 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.884479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.893097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.894813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.895350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.896010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:43.897004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:43.897470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:43.899315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:43.909106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:43.921152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 249/492] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:43.923007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:43.946806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee91-db87-482a-970d-384cea90195a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:43.991176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:43.991828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:43.992311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:43.992724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.006331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.008074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:44.025099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:44.026280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:44.027304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:44.027304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:44.027304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:44.029079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 244/493] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:44.029930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.056369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6315554-7843-4d4d-a3d0-4acc71e4d0cc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.097481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.098112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.098387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.098651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.110065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:44.115160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:44.116088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 250/494] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:44.116890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.145846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e451-479a-4af7-912c-5f5579461df6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.170406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.180790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.190457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.191088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.191432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.191729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.200154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.201843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ceebb693-bc1b-4ffa-ac17-ff4bb3eff30c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:44.215461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:44.216606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 245/495] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619f1-105b-40f0-9f3b-d526c648fb77 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.218081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619f1-105b-40f0-9f3b-d526c648fb77 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.218869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619f1-105b-40f0-9f3b-d526c648fb77 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.221277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 246/496] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:44.221277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02cd9-6a6f-4a2f-b127-dead693523f4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.221277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02cd9-6a6f-4a2f-b127-dead693523f4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.221277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02cd9-6a6f-4a2f-b127-dead693523f4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.222423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 247/497] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:44.223139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de02cd9-6a6f-4a2f-b127-dead693523f4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.232658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9f08-8541-4ad0-b79b-0e68026fc9b3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.276589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.276589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.276589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.276997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.277650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:44.277957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.280017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.294933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 251/498] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:44.296457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.350844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de02cd9-6a6f-4a2f-b127-dead693523f4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.388061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.388678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.389001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.389269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.389947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:44.390249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.391644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829f98-a602-4f1b-95aa-6f5ecfacddb5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.400643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 248/499] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:44.401831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.402105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.402373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.410079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7543f-a4cb-4692-9ab7-6001c711f826 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.419436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.422691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:44.423996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:44.448355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.449029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.449320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.449588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.450341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:44.450640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.452262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b77fa-6f1b-4033-8a82-30e65edbc5f6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.474314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.493706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 252/500] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:44.494954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.495232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.495497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.498828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 249/501] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:44.499601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.521581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:44.523286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:44.608837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 253/502] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:44.610174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.628974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4700cc-a337-429c-b4d6-3b96ef31dc1e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.671860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.673113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.673615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.674230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.684355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.686471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:44.702311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:44.703239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:02:44.704716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:44.710540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 250/503] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:44.710540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.746601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.755779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209484a7-5a1d-43db-ba8c-1a1d83b82684 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.768234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:44.799113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.799842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.800160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.800435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.813352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.815480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:44.831519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:44.832558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:44.833513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:44.833513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:44.833513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:44.833513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 254/504] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:44.833513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:44.843335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309756d-efb0-4cfb-bdf6-9ad220ea6edb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.890320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.891310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.891831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.892175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.946862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a1b8-896b-44fa-a8c7-86a3f538b87b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:44.975902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.977441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:44.986453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:44.987119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:44.987430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:44.987708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:44.988679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:44.989041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:44.990609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.020795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 255/505] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:45.020795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.024082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.030865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.097777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 251/506] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:45.098725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.130114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d52a-2b0e-4140-a8ec-999b0c14ab70 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.177866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.178508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.178789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.179060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.192365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:45.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:45.199576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 256/507] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:45.202264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.227987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bbbd6-39ce-40c1-853d-34256667a28d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.275411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.277750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.278484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.278797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.279202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.279706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:45.280069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.281429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.291064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.300140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 252/508] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:45.301459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.322295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410684d-1ab8-47f8-8c67-e99e0eb917bf None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.377362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.378002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.378278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.378545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.391117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.392628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:45.407740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:45.408997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:45.410036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:45.410036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:45.410036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:45.410036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 257/509] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:45.410036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.421781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472855-17ed-4bef-aeb4-1798dec9e27c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.460305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.460839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.461136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.461394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.523453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58347dc6-c73a-43d0-b6b7-055fcbdbefff None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.536504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.538927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.541274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.542838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.562509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.563141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.563415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.563685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.575477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.576975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:45.592427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:45.593512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:45.594348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:45.594348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:45.594348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:45.594348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 258/510] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:45.594733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.662507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 253/511] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:45.663361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.710965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba94-02e9-460f-bcb7-03b838c43b09 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.745153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.745762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.746582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.746848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.747516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:45.747809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.749244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.757319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 259/512] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:45.758121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.767658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.770982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6514dd-bff0-4c5e-99dd-0d01998536a2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.789100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:45.809207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.809955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.810153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.810418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.817861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.819296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:45.831054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:45.832053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 254/513] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:45.832932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.869637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afba3-779c-40c8-9b8a-b10de8baf19a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.909877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.910485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.910872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.911023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.911664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:45.911979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.913428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.926399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 260/514] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:45.927251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:45.947628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1255a-46ab-4e5a-a45f-e665fc13e416 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:45.983694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:45.984335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:45.984611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:45.984880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:45.985550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:45.985851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:45.987228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:45.999729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 255/515] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:46.000575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.023576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.026177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.036373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3658-9560-402e-9184-a0c47f7a332d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.080814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.081459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.081737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.082006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.093852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.095339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:46.112428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:46.113578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:46.114626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:46.114626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:46.114626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:46.114626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 261/516] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:46.114626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.122090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ab71-eac5-47ec-8c84-350894480088 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.164111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.164757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.165037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.165305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.177197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.178679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:46.194380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:46.195605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:46.196508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:46.196508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:46.196508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:46.196508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 256/517] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:46.196508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.231191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d884ce-74a6-4cf5-a0f3-b726299c70fe None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.265318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.265843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.266125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.266399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.267125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:46.267428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.268893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.269285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.287870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 262/518] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:46.288876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.291483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.306751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8cf-ae34-4ae0-9dcf-d360e3b6cc67 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.343092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.343802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.344159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.344487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.345140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.346578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.367825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 257/519] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:02:46 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:02:46.368705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.412351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158a5d2-0ac4-44bc-b460-2ff3dc139c5a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.453154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.453797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.454068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.454332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.462830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.465021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:46.478252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:46.479266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:46.480178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:46.484462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 263/520] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:46.485737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.507277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570107d5-5400-449c-a956-92369ca5dc40 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.539220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.553728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.553728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.554112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.554247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.554875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:46.555176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.556783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.561694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.572239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 258/521] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:46.577610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.613092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903619ec-8cab-4852-aae8-21d88d490e52 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.653995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.655400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.655859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.656592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.657400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:46.657907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.659423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.672481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 264/522] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:46.674214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.692202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b88db-4e9f-42fd-bc47-983c8c1ef36e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.730569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.731183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.731504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.731713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.796140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.799410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a7a0-fd1d-4216-8114-23256f50603b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:46.814040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.815513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.831247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:46.844440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:46.845010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.845302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.845560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.846253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:46.846546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:46.848014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:46.869841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 265/523] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:46.870718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:46.945868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 259/524] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:46.946736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.001387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aca4d-76df-4af0-a166-0375a6835924 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.038516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.042411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.043311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.043583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.043846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.052032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.053550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.054211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e68bcc-081d-4de8-a4c1-5afc560f956b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:47.066126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:47.067130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:47.067995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 266/525] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:47.068472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.099170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.100135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.100448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.100721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.109169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.110619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.115469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:47.123568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:47.124561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 260/526] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:47.125506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.196717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34877f5-4f95-4221-a835-3cdab3911853 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.231579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.232222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.232528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.232797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.233518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:47.233821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.235240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.251988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 267/527] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:47.251988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.252264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8fd-74f7-4601-b820-806a61ae8b71 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.287832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.288683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.288957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.289223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.304755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.306849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.320988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:47.329567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:47.330547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:47.331376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:47.331376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:47.331376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:47.331376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 261/528] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:47.339491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.413092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac94e-94cf-4ffe-9a0f-1eadce9d6447 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.424751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.460078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.460849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.461135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.461408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.462988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:47.463299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.464766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.485936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 268/529] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:47.487026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.491054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16741851-ac61-4333-a64d-9480a7f9d4e6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.541538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.543891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.544571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.545493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.546435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:47.547418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.549839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.603369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 262/530] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:47.604323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.619859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd37-c402-4c91-82ea-0ca29777f7fc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.662676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.663661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.664141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.665154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.665991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:47.666535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.668290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.670151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.685056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 269/531] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:47.686449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.715830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1ef4-e5f2-4b50-876e-71dda26edb94 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.744380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:47.755555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.756346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.756869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.756993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.757911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=6338b9fc256a401083017d59fc4ceff0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:47.758364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.759908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:47.772079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 263/532] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/role_assignments?user.id=6338b9fc256a401083017d59fc4ceff0&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:47.773385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:47.817157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23a38-e5c2-4966-af8a-f73cf08e1186 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:47.863072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:47.863631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:47.864034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:47.864520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:47.956306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:47.956560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.012501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.072204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 270/533] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:48.080987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.101700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4374c4-e158-4f92-aeae-bc00c433b97f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.160747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.201937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.202586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.203006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.203476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.227715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.230115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:48.254107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:48.255173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:48.255995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 264/534] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 483 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:48.263362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.276725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10b04-6355-40f6-be92-ff489c27f3bd None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.318604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.321186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.321186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.321186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.332356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.333576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.335033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:48.354019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:48.355299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:48.356306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:48.356306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:48.356306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:48.359869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 271/535] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:48.361607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.484959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287f09-1dee-4c9b-9aeb-54c182e99260 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.531043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e1863-658b-4a8b-9400-dd60869a891c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.569825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.570632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.570728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.570942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.571635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:48.571999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.573435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.581827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.582821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.583240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.583646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.584723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:48.585136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.586570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.593102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 265/536] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:48.604003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.619572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 272/537] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:48.626845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.672387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.740621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.745472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99039-5cfa-4492-9aa3-3bee6a35281e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.784399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.786428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.786906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.787362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.795721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.797493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:48.810344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:48.811223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:48.812078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:48.819787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 273/538] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:48.821613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:48.934311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c5653-051b-48eb-84d3-9f1f2ad9325d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.935487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:48.940987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836717c2-28d1-471c-80b3-51e5bf2fc701 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:48.979353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:48.980333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:48.980808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:48.981265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:48.982287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:48.982806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:48.984446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:49.003053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 274/539] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:49.005376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:49.022607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:49.023225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.023604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.023774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.024739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7d4d52c9c7484014bef4a61bd9fd5ccb) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:49.025358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:49.026503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ebecb-1265-45f2-8bd3-8552f4592cab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:49.032781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 266/540] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:48 2022] GET /identity/v3/role_assignments?user.id=7d4d52c9c7484014bef4a61bd9fd5ccb&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:49.033995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2bed-b52b-41ca-b4b3-b3a3c542ab7d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.034277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2bed-b52b-41ca-b4b3-b3a3c542ab7d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.034554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2bed-b52b-41ca-b4b3-b3a3c542ab7d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.035757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 267/541] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:49.045829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.046189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.046422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.081213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:49.082445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:49.126583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0483-661e-454b-ba7f-e9cd6d8249ff None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:49.175391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:49.176065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.176353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.176605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.177517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=4003563bd8444eeea77159305220aced) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:49.177862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:49.179483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:49.192869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 275/542] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:49 2022] GET /identity/v3/role_assignments?user.id=4003563bd8444eeea77159305220aced&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:49.231656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 268/543] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:49.550490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:49.588363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:49.713837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4661f-8f7c-46b6-abac-6c7b97c19d08 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:49.771873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:49.772567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.772849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.773120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.789937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-12509e81-1345-4f9a-b384-edbfce93b3d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:49.795627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:49.796694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:49.797784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 276/544] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:49.805141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:49.864953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:49.871055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4107-987f-49f6-9dcf-bf3fdf330f74 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.871382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4107-987f-49f6-9dcf-bf3fdf330f74 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.871599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4107-987f-49f6-9dcf-bf3fdf330f74 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.874182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 277/545] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:49.879457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a70f7-1284-4b09-9070-033f568db134 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:49.880560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a70f7-1284-4b09-9070-033f568db134 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:49.880978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a70f7-1284-4b09-9070-033f568db134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:49.901129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-885a70f7-1284-4b09-9070-033f568db134 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:49.902486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-885a70f7-1284-4b09-9070-033f568db134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:49.982565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 278/546] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:50.000340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f930-e386-4c86-9559-c9dc44060848 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:50.042066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:50.042799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.043077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.043350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.044072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:50.044382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:50.045899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:50.057184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 269/547] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:50.065241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a70f7-1284-4b09-9070-033f568db134 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.096373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:50.222514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a70f7-1284-4b09-9070-033f568db134 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:50.272215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:50.272926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.273209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.273533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.286671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:50.293655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:50.293846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:50.311778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:50.312863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:50.313721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:50.313721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:50.313721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:50.314446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 279/548] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:50.323908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.468325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:50.534007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:50.540663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b52362-5607-47e1-9990-23ebc04147d2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:50.544105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9002-a000-4206-9ff1-f1839a6824b2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:50.595572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:50.597049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.597997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.598377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.605753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:50.606536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.606917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.607457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.608375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:50.608778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:50.610220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f83a4-c30e-4d83-9328-b06dec7e2b02 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:50.616969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:50.623728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 280/549] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:50.626151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7619a3-c544-4ccf-8550-37e8b1a55422 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.626437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7619a3-c544-4ccf-8550-37e8b1a55422 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.626709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7619a3-c544-4ccf-8550-37e8b1a55422 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.628012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 281/550] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d5bc36ff-c7ac-4fd9-bfba-61d157e6545c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:50.628516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:50.629409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:50.630720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 270/551] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:50.632022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7619a3-c544-4ccf-8550-37e8b1a55422 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.634565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.636026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.636026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.654957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:50.656259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:50.735284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 271/552] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:50.736300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.790009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7619a3-c544-4ccf-8550-37e8b1a55422 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:50.844445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:50.858044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:50.858604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:50.858877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:50.859154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:50.873409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:50.874873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:50.903523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:50.904877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:50.906459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 282/553] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:50.909565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:50.911044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:50.959456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94731bfa-7e14-46ec-a163-b63f74fb06bd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.043401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8095-841e-4cfd-be73-3fcd70b1f60c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.068969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.069716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.069991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.070844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.071628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:51.071948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.073532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.085377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 272/554] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:51.086375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.092527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.093323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.093693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.094041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.094890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:51.095196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.097111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.116752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 283/555] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:02:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:51.117852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.185454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.242471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04f6d-2602-4f4f-b9e7-516962251064 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.256225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0d18-3482-451c-90a8-c8d3cda5071e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.282907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.284122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.284612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.285137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.297382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.298018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.298297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.298565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.299084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:51.304977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:51.305869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:51.306693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:51.313890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.313890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.314274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 273/556] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:51.316354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:51.329460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:51.330966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:51.331823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:51.331823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.331823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:51.331823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 284/557] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:51.331823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.334889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.439010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1149291-c908-4467-9bca-340eb750f62c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.460869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.471210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0a72-971d-43cd-956f-6919986cd68e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.480356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.481225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.481648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.482194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.519280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.519900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.520211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.520479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.521157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:51.521450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.523059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.532450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 285/558] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:51.533994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.562420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.564371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.577644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.648770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcdfe-e4f5-4bea-b615-0f4445974cf5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.685599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.686136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.686419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.686690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.687372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:51.687685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.689120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.691718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 274/559] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:02:51.692812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.714794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 286/560] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:51.714794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.733455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.823756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5578-0c88-45bb-a840-03a07f610ca0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.836060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869da3-8519-4dfb-b2ee-c7c6471a3efe None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:51.836619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:51.870722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.871632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.871904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.872203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.878798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:51.879447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.879726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.880020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.883939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.885502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.892893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:51.894490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:51.903436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:51.904584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:51.905543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:51.905543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.905543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:51.906292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 275/561] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:51.907286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-8bb6ba28-1561-4455-b98e-73198edd0471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:51.916466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:51.918097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:51.919090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:51.919090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:51.919090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:51.919090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 287/562] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:51.919831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b666-64ec-4e52-a1e2-b551183401d1 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:51.919939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b666-64ec-4e52-a1e2-b551183401d1 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:51.920198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b666-64ec-4e52-a1e2-b551183401d1 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:51.921808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 288/563] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:51.923936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b666-64ec-4e52-a1e2-b551183401d1 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.000098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.037713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a5ee3-a56e-452c-b74e-27c4eb7f5049 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.040028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b666-64ec-4e52-a1e2-b551183401d1 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.074930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.075307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.075539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.075815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.075937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.076115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.076238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.076507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.076757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:52.077058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.078429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.085550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.087008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.091871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 289/564] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:52.092743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e22b03ca-aef2-4187-91f3-276d2cb536f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:52.099512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:52.100649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:52.101579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 276/565] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:02:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:52.102157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a0d7-2a64-4cb3-a535-9088189216b6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.102157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a0d7-2a64-4cb3-a535-9088189216b6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.102281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190a0d7-2a64-4cb3-a535-9088189216b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.121134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a190a0d7-2a64-4cb3-a535-9088189216b6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:52.122536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a190a0d7-2a64-4cb3-a535-9088189216b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:52.140852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.199441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 277/566] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:52.215078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396c-532a-466a-ae27-0db56d0605fd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.215078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396c-532a-466a-ae27-0db56d0605fd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.215078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396c-532a-466a-ae27-0db56d0605fd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.215078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 278/567] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:52.215078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c396c-532a-466a-ae27-0db56d0605fd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.215399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2ba45-7d30-4b52-8822-6ca132d0b37c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.240740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.250746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.251769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.252245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.252738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.253720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:52.254019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.255434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.271426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 290/568] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:52.272374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.337694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c396c-532a-466a-ae27-0db56d0605fd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.375599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.376798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.377072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.377351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.385115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.386794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.394818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0aa8-58a9-40e9-923e-86bac2d3e1ba None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6ef95851-d7c7-4cc6-b6f9-0e21b469a347 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:52.400604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:52.402603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:02:52.403540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:52.406653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 279/569] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:52.408155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.408441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.408718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.427305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:52.428525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:52.436654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.441208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.442358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.442836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.443273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.444337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:52.444810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.446501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.466226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 291/570] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:52.467323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.507242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 280/571] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:52.508061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.523157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.580582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0837-fc81-4c8f-bd10-a490ff540fd3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.617751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fef04-045d-495e-bd23-ace44c7b9aa1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.621429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.622064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.622340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.622610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.630922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.632591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:52.647986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:52.649531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 292/572] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:52.650486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.661519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.662733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.662733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.662914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.663650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:52.663951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.665448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.682972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.693523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 281/573] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:52.693523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.773574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e052e26-6b31-4c3c-8550-206d9f79c8a2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.781974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.814274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6befad-9fc1-47d9-bc15-45eb3271afd7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.816767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.817397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.817673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.817943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.828200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:52.829658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:52.845636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:52.846721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:52.847565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:52.847565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:52.847565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:52.847565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 293/574] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:52.847565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.857542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:52.858478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:52.858945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:52.859244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:52.871979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:52.877576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:52.878504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:52.879313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 282/575] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:52.880506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:52.947432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:52.968581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51fc9-10ae-4036-a9e1-8c8c1ec04b14 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:52.990646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead9bd-3ae9-40dd-98c9-b4112f0b6db9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.003567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.004202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.004501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.004747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.005443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.005743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.007178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.019778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 294/576] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.021116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.025755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.026321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.026594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.026861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.041718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.042439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.044579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:53.061978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:53.063016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:53.063894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:53.063894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:53.063894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:53.064376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 283/577] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:53.065177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.138244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03d95-4cbd-4c9f-b22b-bc2ca6600f61 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.177428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.178072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.178354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.178624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.178847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b337d8-498b-41c6-b484-c190b3734bc7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.192046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:53.194488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:53.197264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:53.198231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:53.199064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 295/578] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:53.199762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.228345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.228950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.229226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.229490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.230519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.230519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.231850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.245624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 284/579] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.246471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.291440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.314095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcef26-d245-41a5-b917-4218a7af1a59 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.350112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.350410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df787-5245-4a56-b736-4fb5c3475212 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.350717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.350994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.351261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.351929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.352260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.353626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.362470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 296/580] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.363302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.391911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.392608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.392965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.393320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.394101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.394402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.396254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.402463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 285/581] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/role_assignments?user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.403303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.451913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.508196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b40bc-dd36-45fe-94de-67f2a1a9b4a6 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.538290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bc24-2250-434b-b124-c5980fdfc049 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.550747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.551335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.551712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.552009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.552687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.552989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.554475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.565385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.571245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 297/582] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.575702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.587846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.588658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.588777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.589033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.589719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:53.590011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.591374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.601487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 286/583] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.605777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.704250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b217-cad8-4094-ad61-20c728d7c835 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.718996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.724212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3f54-7f74-4197-a3fb-6c8cffd5334e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.759433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.760117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.760397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.760671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.766291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.766984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.767288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.767567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.769694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.772915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.786183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.788660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:53.796619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:53.797656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 298/584] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:53.805901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:53.819083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:53.820079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:53.820945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:53.820945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:53.820945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:53.821753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 287/585] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:53.822982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:53.879890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:53.929329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fc12-1d94-4bcb-bae8-9da9fcef3844 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.948582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5168e8c-3b22-4f53-ba60-7fec5e99ccb3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:53.969359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.969986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.970257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.970968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.985657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:53.987215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:53.991949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:53.992617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.992949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.993223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:54.000377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:54.001250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:54.002112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 299/586] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:54.003615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.011310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.012817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:54.028602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:54.029546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:54.030499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:54.030499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:54.030499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:54.030499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 288/587] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:54.030499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.033367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.125973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c6f2-e53d-4989-a169-3218f6edafbb None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.147939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a785a-cdd6-47df-b9cc-df52260b7b5b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.149353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.169453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.170700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.171062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.171264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.171878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:54.172205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.173742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.192467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 300/588] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:54.192467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.194772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.195458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.195739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.196039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.196691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:54.196988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.198347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.216289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 289/589] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:54.216289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.279432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.328476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56116f-9da8-4f34-b528-700184f7d7c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.329865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d1ad-1059-4aa7-9b55-e5f21039aacf None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.365307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.365925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.366197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.366469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.367110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:54.367412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.368805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.372442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.373622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.373896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.374158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.374840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:54.375137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.376659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.381726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 290/590] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:54.382685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.397815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 301/591] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:54.397815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.440986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.502725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aea3f-6fba-4f79-8aef-e3271392edce None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.521753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303c75b-8ab4-44d8-a2be-ffe3b5f5a34e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.535404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.548744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.549542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.549836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.550113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.562473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.563538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.564057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.564540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.566523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=056e6c0714cf4827a3b118d0bddfb182, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.568037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.575231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.576761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.584898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 291/592] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:54 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:54.586071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:54.602219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:54.603495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:02:54.604726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:54.607771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 302/593] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:54.608938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.734997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:54.738914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d816-9fff-4532-94db-17364c80ef93 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.749432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8091-e03d-4f54-8e99-bf08e9636196 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:54.780301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.781240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.781527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.781803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/6338b9fc256a401083017d59fc4ceff0/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.790456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:54.791365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:54.791801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:54.792249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.801506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.801718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=6338b9fc256a401083017d59fc4ceff0, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:54.804813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.804937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:54.819626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:54.820831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 292/594] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:54.821764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.831885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 303/595] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:54 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/6338b9fc256a401083017d59fc4ceff0/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:54.832818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:54.908082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:55.034721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1726f-328b-444f-9b63-02befc1fcada None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.072459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.073060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.073332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.073599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.074322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:55.074620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.076827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.103147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ae82-0609-40fb-b0e4-ed6da16ad957 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.103567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 293/596] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:55.109124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.178473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.179335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.179811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.180344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.181769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:55.182283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.184847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.221655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 304/597] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:55.224988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.236405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:55.305254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:55.316779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190beacd-f3d5-483b-b1d4-f6ba55ee1523 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.371456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.372891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.373316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.373757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.398348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.401392 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:55.423415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:55.424636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:55.425772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:55.425772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:55.425772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:55.432728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 294/598] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:55.435394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.440072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfca01-9880-4c8a-94bd-ce8ad0b90860 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.518690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.520287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.520287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.520287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.556541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.557933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.566130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817563-9995-4275-932d-2d663ee0a48c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:55.594952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:55.596006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:55.596916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:55.596916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:55.596916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:55.602487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 305/599] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:55.609337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.633497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.634493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.634968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.635713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.637834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:55.640356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.642035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.674476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 295/600] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:02:55.694490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.708382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:55.720404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:55.770551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb8b66-4bfd-4569-83b3-18950f12085b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.823909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.824626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.825028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.825298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.826401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:55.826701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.828444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604744-8733-43e9-b5bf-b91129690611 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.832993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a522-6c94-4dcf-9960-31e00d7f492f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.846422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 306/601] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:55.848074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc070-dcc3-424f-a207-2d7fc74afd87 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.848440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc070-dcc3-424f-a207-2d7fc74afd87 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.848708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc070-dcc3-424f-a207-2d7fc74afd87 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.852063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 307/602] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:55.853097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cc070-dcc3-424f-a207-2d7fc74afd87 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.904357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113cfed-84e3-495c-8421-993631243950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.906106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cfed-84e3-495c-8421-993631243950 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.906415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cfed-84e3-495c-8421-993631243950 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.906679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cfed-84e3-495c-8421-993631243950 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.917274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113cfed-84e3-495c-8421-993631243950 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.919275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113cfed-84e3-495c-8421-993631243950 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5113cfed-84e3-495c-8421-993631243950 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:55.936249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:55.937655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:55.939654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:55.947978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 296/603] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:55.947978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.947978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.947978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.966377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:55.967935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:55.991802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cc070-dcc3-424f-a207-2d7fc74afd87 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.014523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.031890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.032607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.032881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.033148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.041421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.043529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.048930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:56.059109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:56.060232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:56.061184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:56.069597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 308/604] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:56.069597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.070492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 297/605] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:56.072698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.187905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d2e99-8960-40d9-acc8-44afd81809e6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.205672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f8f3-3a59-4ddf-b215-405dbb02c208 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.249352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.249994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.250304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.250587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.251388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:56.251695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.253202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.264868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.265494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.265772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.266041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.266749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:56.267054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.268525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.274121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 298/606] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:56.281282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.294711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 309/607] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:56.301775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.376175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.376731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.464799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69324911-9a60-4cfb-a6ca-a98dee546e5d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.470226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11a2ae-717e-46b1-bb8a-797ca238872e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.507064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.507918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.508225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.508503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/4003563bd8444eeea77159305220aced/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.514430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.515155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.515500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.515843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7d4d52c9c7484014bef4a61bd9fd5ccb/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.529109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=4003563bd8444eeea77159305220aced, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.530900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.533911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=7d4d52c9c7484014bef4a61bd9fd5ccb, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.536170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.547919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 299/608] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:56 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/4003563bd8444eeea77159305220aced/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:02:56.549150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.551530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 310/609] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:56 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7d4d52c9c7484014bef4a61bd9fd5ccb/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:56.686218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85275f-f12d-4b15-81f5-1c06787dddaa None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.688405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.732400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.733349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.733807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.734254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.747928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:56.753547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:56.754567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:56.755414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:56.757970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 300/610] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:56.766929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:56.911898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:56.924867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09512be-9126-4cfe-b6a9-1209b99ba40b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:56.968617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:56.969227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:56.969499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:56.969764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:56.970431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:56.970726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:56.972100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:56.988315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 311/611] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:56.993573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:57.131808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4842-5330-4aa8-af2a-39c62a8586d6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:57.198433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:57.199085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.199362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.199634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.220823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:57.222449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ac747ad5-b4a6-4e20-a5bc-27c035284fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:57.248035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:57.249012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:57.249930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:57.249930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:57.249930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:57.249930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 301/612] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:57.255198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:57.390934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1645-ad8c-4cb4-b359-3be0bf740f33 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:57.409914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2fd63-bdfa-441a-9016-f729f309ef01 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.410450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2fd63-bdfa-441a-9016-f729f309ef01 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.410649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2fd63-bdfa-441a-9016-f729f309ef01 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.412895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 302/613] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:57.420536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098395-7295-4eb9-ab0a-e145ad952152 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.420923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098395-7295-4eb9-ab0a-e145ad952152 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.421300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098395-7295-4eb9-ab0a-e145ad952152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.427218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:57.427832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.428144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.428416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.429078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:57.429380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:57.430740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:57.445028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 312/614] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:57.451520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:57.462481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7c098395-7295-4eb9-ab0a-e145ad952152 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:57.469912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7c098395-7295-4eb9-ab0a-e145ad952152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:57.479869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:57.483841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:57.595499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074a3a-e919-4d14-bb24-13f7bbff7950 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:57.638781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 303/615] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:57.646903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:57.647925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.648492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.648960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.661132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:57.662983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:57.674801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19f3c-cbbb-4662-a7ec-3f80e40fd496 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.675118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19f3c-cbbb-4662-a7ec-3f80e40fd496 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.675343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19f3c-cbbb-4662-a7ec-3f80e40fd496 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.680781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 304/616] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:57.681516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:57.682455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:02:57.683385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:57.683916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.683916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.683916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.686135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 313/617] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:57.693258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:57.717571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:57.720316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:57.822866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:57.876433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 305/618] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:02:57.903933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578e71-5c26-4ca8-84ca-9f54f3093b5e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:57.963065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:57.964575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.965059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.965557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.966504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:57.967012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:57.968681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:57.989335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 314/619] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:02:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:57.994592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:57.994953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.157986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2256e-da4b-4e0d-980b-e276ba4f425d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.160113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.211465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b74751-73c6-41c3-853d-b9767d792c76 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.217321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.223660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.224389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.224662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.224928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.238025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:58.243197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:58.244417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:58.245408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:58.248040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 315/620] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:02:58.249537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.259539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.260543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.261003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.261470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.273800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.276420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:58.294045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:58.295089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:58.295999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:58.295999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:58.295999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:58.298200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 306/621] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:58.299270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.385021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816efdb-a1d9-476b-95a3-6d06ea8d541b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.417839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e711-f6d6-40dd-9828-082803f711c8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.430870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.431593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.432428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.432779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.448720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:02:58.450190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:02:58.459545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:58.460888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:02:58.461786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:58.465475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.466376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.466881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 316/622] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:58.467004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.467460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.467839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.468592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:58.469146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.470825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.481811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 307/623] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:58.483043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.539755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.608591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb8363-ba47-4341-a3b2-0b50364e5a18 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.650718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.651723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.652259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.652749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.653613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:58.654123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.655718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.672707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 317/624] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:58.674053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.674780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185849f-cd7d-4478-9890-9d3f1592c0bb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.726179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.727355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.727582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.727852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.728565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:58.728864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.730641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.748066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 308/625] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:58.750053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.798106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38ec1-b8be-42a7-8d00-8b636d5df4b2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.810997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.832369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:58.842223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.842815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.843096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.843369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.855881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.857465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:58.874382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:58.875368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:58.876369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:58.876369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:58.876369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:58.880389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 318/626] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:58.881454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.908634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb3d3-ce11-437e-b7f9-2cbe668b29c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.957740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.959054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.959482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.959907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.970240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.972818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:02:58.993424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:58.994511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:02:58.995469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:02:58.998908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 309/627] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:59.000374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.015226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cb2e-1f0b-49d8-b617-b0738b1b66fd None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.058283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.059023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.059414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.059753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.072944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.074525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:02:59.092827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:59.093813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:02:59.094678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:02:59.094678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:02:59.094678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:59.098900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 319/628] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:59.099902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.121143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.144650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d78-f184-4dbd-9fbd-4a52b3b9f651 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.157248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.184979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.185889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.186007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.186202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.186878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:59.187184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.188772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.207039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 310/629] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:59.207039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.250402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94517999-41ea-4bf9-be25-6f6489f342ef None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.293790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.294405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.294693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.295021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.296243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:59.296243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.297535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841eb3-0879-4cea-bed1-1f68ba321c1d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.317540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 320/630] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:59.318982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe09b7-daf6-4c08-a83b-f8cf44827628 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.319259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe09b7-daf6-4c08-a83b-f8cf44827628 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.319538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe09b7-daf6-4c08-a83b-f8cf44827628 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.320939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 321/631] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:59.321646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe09b7-daf6-4c08-a83b-f8cf44827628 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.355734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931812f-967d-45a0-b219-d7f1ff94a3ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.404596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.405220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.405501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.405773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.406426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:59.406745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.408154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.422702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 311/632] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:59.424247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.437494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.469516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe09b7-daf6-4c08-a83b-f8cf44827628 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.484418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.513488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.514130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.514401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.514816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.526586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.528815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6a6d46d5-f6ef-4840-a4ed-1e81fa4e511b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:02:59.542524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:02:59.543711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:02:59.544880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 322/633] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:02:59.545578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4daf5-7587-4147-9554-59d37546acac None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.545578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4daf5-7587-4147-9554-59d37546acac None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.545836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4daf5-7587-4147-9554-59d37546acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.564103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-69e4daf5-7587-4147-9554-59d37546acac None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:59.565304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-69e4daf5-7587-4147-9554-59d37546acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:59.582030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c272-25af-4a50-b1fb-1c11b451d335 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.623253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.623916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.624225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.624489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/8f7865ffcaff4e8e8bdd7ceac7b27c3d/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.641397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=8f7865ffcaff4e8e8bdd7ceac7b27c3d, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.642855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8389-978c-40d9-800a-46499e2e891f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.644787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 323/634] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:02:59.646170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4daf5-7587-4147-9554-59d37546acac None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.671029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 312/635] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:02:59 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/8f7865ffcaff4e8e8bdd7ceac7b27c3d/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:02:59.672668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4871-3f40-497b-acc5-d96754c6214f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.673338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4871-3f40-497b-acc5-d96754c6214f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.673947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4871-3f40-497b-acc5-d96754c6214f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.676528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 313/636] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:02:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:02:59.678242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4871-3f40-497b-acc5-d96754c6214f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:59.797849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.867933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:02:59.883934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4daf5-7587-4147-9554-59d37546acac None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.910652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4871-3f40-497b-acc5-d96754c6214f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:59.953254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.954688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.955434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.956161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.971227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.974269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:59.980693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:59.981680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:59.982108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:59.982549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:59.983760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:02:59.984300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:59.986812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-480fe539-1f4d-4a47-ae80-61bffe9d0b03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:00.001059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:00.002802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:03:00.004470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:00.008707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 324/637] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:02:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:00.011106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.011932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.012738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.024186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 314/638] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:02:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:00.025960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:00.043268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:00.045414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:00.180558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 325/639] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:00.180558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:00.220077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf52e52-196a-4079-bb43-246647c0d2c6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:00.262120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:00.307394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:00.308919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.310622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.311429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.325886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2dcf-04a1-4f6c-a647-c8d858243e86 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:00.329961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:00.340640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:00.351263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:00.353400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:00.355307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:00.359621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 315/640] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:00.361443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:00.381408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:00.382206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.382699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.383145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.384039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:00.384453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:00.386045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:00.414466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 326/641] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:00.415813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:00.547026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80248d-0ca3-448e-944a-9c0bea50836b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:00.564383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:00.578588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3cc1-471f-42df-aa25-bd6fdcc648d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:00.596672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:00.597691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.598225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.598528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.599344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:00.600333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:00.602495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:00.613195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 327/642] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:00.619245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:00.654750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:00.656146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.656839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.657672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.751577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4267-d991-4d49-a9a9-108b0b04beee None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:00.789477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:00.793912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:00.794127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:00.794955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.795242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.795613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.797268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:00.871494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:00.918730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:00.920246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:00.938825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 316/643] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:00.938825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.064499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 328/644] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:01.065324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.095760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.102947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca5d2-09f9-4d30-91f5-88d8c749830b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.170233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.183484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.185450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.185951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.186411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.204958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.206043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca61f2-7d77-46df-a247-9dbba8538633 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.206406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:01.223490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.224923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:01.226679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:01.226679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.226679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:01.226679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 317/645] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:01.226679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.260519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.261382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.261843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.262257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.277003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:01.283399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.285298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 329/646] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:01.287239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.360768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c833-40f8-4a23-aae1-ef5b414940a8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.399413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.400168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.400463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.400733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.413105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.414600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:01.431671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.437752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:01.438867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:01.438867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.438867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:01.438867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 318/647] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:01.438867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.440227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.459736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c1ff-274c-422c-a133-ef6e0227b4b4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.502364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.503139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.503483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.503826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.507216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.521904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.523615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:01.540276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.542171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:01.543985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:01.543985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.543985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:01.543985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 330/648] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:01.543985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.614977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cc72-d7ec-4b81-a31d-31396d15eb75 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.657587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.658209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.658486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.658755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.659420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:01.659719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.661772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.679994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 319/649] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:01.681775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.710119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4467-a70c-45e7-87bf-0a8df797d920 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.750785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.751502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.751857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.752228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.753009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:01.753428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.755013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.772018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 331/650] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:01.772018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.791864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.855065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.857735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8de6-b1f6-49f9-845b-c9f8dfa14bcf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.901293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.901823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.902103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.902373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.903030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:01.903328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.904752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.918878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f81-dc9c-43fa-9d8a-5b1b4b113088 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.920208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 320/651] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:01.921503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.979723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056853-3032-4979-8a4f-90613206ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.980662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056853-3032-4979-8a4f-90613206ffae None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.981087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056853-3032-4979-8a4f-90613206ffae None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.981487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056853-3032-4979-8a4f-90613206ffae None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.982440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056853-3032-4979-8a4f-90613206ffae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:01.982883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056853-3032-4979-8a4f-90613206ffae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.985002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056853-3032-4979-8a4f-90613206ffae None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.004179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 332/652] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:02.005682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056853-3032-4979-8a4f-90613206ffae None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.081029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31f96-2ab0-4cb5-bd42-8213b1fed20c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.114075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.130210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.131035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.131459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.131858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.143907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.146564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.151781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056853-3032-4979-8a4f-90613206ffae None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:02.161410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:02.162479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 321/653] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:02.163805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.176837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.214015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.214663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.214937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.215220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.227867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.229374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:02.246756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:02.247784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:02.248695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:02.248695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:02.248695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:02.248695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 333/654] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:02.248942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.330425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715f2f-159e-4fd7-ab48-2a40f62f6849 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.368187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.368834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.369114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.369385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.377007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.378514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.389793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daafffd-5d97-48d2-ac26-e4d0a3f8888f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:02.391439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:02.392959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 322/655] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:02.395334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.432245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.432862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.433140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.433412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.440352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.442356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.442863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:02.454086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:02.455191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 334/656] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:02.456808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.480706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.507261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87080-f6cf-47f5-b72f-090b81404fef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.542458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.543077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.543360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.543630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.544409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.544716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.546268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04231ee-2504-4ab9-8413-becd63b6f057 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.563194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d5cb-05b2-4a57-a5f1-488419a3d3ec None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.571548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 323/657] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:02.572894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac003f-a98b-4222-9744-f6519ff6919e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.573177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac003f-a98b-4222-9744-f6519ff6919e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.573452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac003f-a98b-4222-9744-f6519ff6919e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.574995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 324/658] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:02.575657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac003f-a98b-4222-9744-f6519ff6919e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.607879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.608520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.608793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.609056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.609700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.609994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.611426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.624957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 335/659] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:02.625824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.700104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.704534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac003f-a98b-4222-9744-f6519ff6919e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.752041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:02.752303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.752669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.752950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.753219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.754482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.754776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.756551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.769702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 325/660] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:02.770577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.786348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338727d0-1107-4359-8545-5b203a5196bc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.834721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.835458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.835797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.836174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.837017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.837426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.839019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1342-8baa-4bfa-b97c-5c315a4ff6aa None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.852950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 336/661] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:02.854284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.854573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.854842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.874461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:02.875668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:02.909705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934104be-85f2-457d-be60-1657fbfc8cd7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.957798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.960013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 337/662] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:02.960155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.960155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.960344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:02.960415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.007702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.055791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.078117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.080968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.103739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0138e84-d3f7-499a-93aa-33c3a635fbb9 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.151846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.152932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.152932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.153271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.166654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.168169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:03.182517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:03.192280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 338/663] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:03.194499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.230560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 326/664] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:03.231229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.304396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.333331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9d7a-5d23-4419-b94f-e78f154466f0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.355054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96f057-1868-4fbf-a88f-d56fe02bdb04 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.370875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.381895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.383212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.383673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.384507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.385978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:03.386610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.388334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.392236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.392845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.393118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.393523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.394155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=6338b9fc256a401083017d59fc4ceff0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:03.394456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.395006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 339/665] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:03.395893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.396073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.412794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 327/666] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/role_assignments?user.id=6338b9fc256a401083017d59fc4ceff0&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:03.413697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.581684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07934da-8fcd-4a2a-83e0-ebd652891086 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.614146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d495e-b364-4b5f-bbfe-19cafd07df32 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.654704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.664868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.665431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.665709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.665982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.666738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:03.667046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.668560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.679443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.680685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.680685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.680957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.690522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 340/667] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:03.691413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.695334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:03.697488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:03.716188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:03.718481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:03.719502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:03.719502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:03.719502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:03.719502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 328/668] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:03.719502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:03.781149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:03.888985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ad1c-d092-43e5-9530-9be2a38dd776 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.947593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def29e42-a5fa-438a-8594-91583f0bb89a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:03.968282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.969730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.970279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.972011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.992775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:03.993855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:03.994346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:03.995006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:03.996217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:04.005216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:04.006213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:04.007043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:04.012318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 341/669] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:04.013536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.067674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.102678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.105114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.197981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699ba2-e121-4330-902f-0dddfddae4b4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.231588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.268076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 329/670] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:04.269196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.270984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.272345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.273037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.273805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.275701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:04.276583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.279479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.308131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 342/671] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:04.310252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.362636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.392236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345d0e-e2e8-4956-9c79-b7240ab40cde None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.434130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.434980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.435404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.435923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.436803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:04.437348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.438918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.440996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63eb2-200e-4a7e-82b4-fb52250e9f7e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.454080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 330/672] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:04.456334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.480338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.481074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.481427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.481794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.496370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.498063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:04.514395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:04.515447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:04.516589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:04.516589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:04.516589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:04.516589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 343/673] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:04.522803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.550778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.596327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172204e-5bf1-4c45-b3a2-f3751a16208a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.633574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa02a7c-9fa5-4957-9197-efbbafc00aca None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.647429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.648431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.648859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.649279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.660738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.662958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.669801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.674494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.675264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.675634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.676024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:04.688417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:04.690095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:04.691198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:04.691725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.693067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.693693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 331/674] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:04.694980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:04.727870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:04.729120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:04.730228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:04.730228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:04.730228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:04.739483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 344/675] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:04.739483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.853804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab8a3-b64e-4ad3-a362-33c864f6a445 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.859512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:04.895410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fe44a-ae58-42e5-ae05-48112648143d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:04.910892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.912399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.912872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.913325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.914748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:04.915249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.917165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:04.937373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 332/676] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:04.938755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:04.963652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:04.964838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.965409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.965979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.967381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:04.967999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:04.971756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.000502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 345/677] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:05.002684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.026944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.091499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2f326-6282-4cb6-980e-378def1131cc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.151093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.152001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.159208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.159546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.160436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:05.160829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.162431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.182459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 333/678] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:05.183676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.192062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c9d6-476e-4ba3-8f52-a9c36cd0f645 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.239498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.240294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.240705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.241226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.246572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.252915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.255680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:05.274781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:05.278686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 346/679] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:05.280787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.355940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a065c8-317c-44ce-97de-44249ac53c35 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.384375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.413806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.414851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.415561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.415995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.417527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=4003563bd8444eeea77159305220aced) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:05.417975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.420885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.436041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 334/680] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/role_assignments?user.id=4003563bd8444eeea77159305220aced&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:05.437171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.446672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba804-a215-4e42-8ad7-32fcb328d755 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.531734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.532705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.533140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.533562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.552965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.555128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:05.583559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:05.584794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:05.590773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 347/681] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:05.604072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.619194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f9e53-9f2d-4b3d-aadd-0f1851a8527a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.659884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.660798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.661270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.661715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.662681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:05.663184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.664843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.680860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 335/682] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:05.695239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.708813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.756883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4e60-6f82-48f2-a9ce-0696c03c9db2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.794192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.800187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3740-7731-4292-8fb6-934443862732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.801262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3740-7731-4292-8fb6-934443862732 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.801262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3740-7731-4292-8fb6-934443862732 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.801597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3740-7731-4292-8fb6-934443862732 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.802450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3740-7731-4292-8fb6-934443862732 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:05.802941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3740-7731-4292-8fb6-934443862732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.804451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3740-7731-4292-8fb6-934443862732 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.826163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 348/683] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:05.835159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3740-7731-4292-8fb6-934443862732 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.886792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7bb8-5a4b-4bab-9ac8-ffadd60b5796 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.929253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.930047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.930326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.930712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.931445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7d4d52c9c7484014bef4a61bd9fd5ccb) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:05.931754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.933382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407a279-2ab2-43e9-acf3-21807c73652a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.940445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 336/684] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/role_assignments?user.id=7d4d52c9c7484014bef4a61bd9fd5ccb&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:05.941730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f6e7-f667-4493-934f-f5e882cf169f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.942020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f6e7-f667-4493-934f-f5e882cf169f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.942293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f6e7-f667-4493-934f-f5e882cf169f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.943890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 337/685] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:05.955087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3740-7731-4292-8fb6-934443862732 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.957966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f24e-abef-42c7-bfc0-56c5bd7bb249 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.958248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f24e-abef-42c7-bfc0-56c5bd7bb249 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.958520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f24e-abef-42c7-bfc0-56c5bd7bb249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.974612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.981954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a006f24e-abef-42c7-bfc0-56c5bd7bb249 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:05.983849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a006f24e-abef-42c7-bfc0-56c5bd7bb249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:06.006400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.007400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.007879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.008405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.092969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 338/686] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:06.102290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.104099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.266250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ed4c-a464-4e89-9f5d-3aa8ea1e593e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.266531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ed4c-a464-4e89-9f5d-3aa8ea1e593e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.266691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ed4c-a464-4e89-9f5d-3aa8ea1e593e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.272210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 339/687] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:06.278903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.279304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.279657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.317753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:06.319375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:06.329605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 349/688] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:03:06.336476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.362073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.396070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.431128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 340/689] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:06.470753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.500527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49091c-13ce-46d0-9808-e68d7a2dc5bc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.564164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.564824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.565717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.566120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.581002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.582466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:06.601445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:06.602551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:06.603690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:06.603690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:06.603690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:06.603690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 350/690] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:06.612211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.615376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b932-2f03-40ae-9f6c-1805c8644740 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.677284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.677935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.678213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.678486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.705365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:06.710477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:06.711453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:06.712348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:06.716371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 341/691] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:06.719622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.719832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.769928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.781516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc280b-37a0-4026-b6a5-9bae93aaca38 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.824006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.824564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.824889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.825629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.825828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:06.826117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.827827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.841361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 351/692] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:06.842258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.872732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f440cf2-a56c-4ee3-a0b7-9c8898aa11b7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.915371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.916041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.916369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.916907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.917645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:06.917955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.919559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.938279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 342/693] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:06.939396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.987581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26b49-c1aa-4347-b856-23dec0bcbe52 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.017384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.028057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.028275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.028540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.028800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.029469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.033948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:07.057172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:07.058229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:07.059073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:07.060751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.065086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 352/694] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:07.066016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.080294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de07b1-3e6b-4f29-bb07-993cf23ee49e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.127555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.129675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.130216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.131263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.145865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.148656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:07.169345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:07.170291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:07.171770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:07.181414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 343/695] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:07.183287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.294193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38707-5dd9-485e-9ead-e86bdcda6016 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.364782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.365417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.365656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.366746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.387782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.390267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.404077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0fe41-e4c6-4aee-b63f-35cff3182b9e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:07.416336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:07.417361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:07.418270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:07.418270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:07.418270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:07.420919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 353/696] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:07.422034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.502698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.503597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.503886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.504216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.504971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:07.505277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.506768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.516710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.529791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 344/697] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:07.529791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.577188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.638982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9eab7-4fa0-422b-a4c6-7dabedab4b41 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.696095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.697521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.698110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.698717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.700276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:07.701513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.704996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.716193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02badba0-3a77-4b39-8973-b55993d90d4b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.732699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 354/698] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:07.734665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.758758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.759792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.760253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.761113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.762220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:07.762677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.764968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.781649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 345/699] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:07.782754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.885254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55206b6-2806-489e-83dc-1d86b889aa1c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.887392 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.903322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.942729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.944883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.945245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.945621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.946424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:07.946852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.948393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.948729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932715-ed3b-487d-ad0c-7c2e981b6ac2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.964316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 355/700] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:07.965476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.997204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.999327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.000056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.000579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.002535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:08.003290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:08.005330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:08.016049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 346/701] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/role_assignments?user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:08.167481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98310-e030-440e-b670-a55e38366f3c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:08.234635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:08.235379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.235665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.235940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.249520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:08.251146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4aebaba2-f0ac-469e-9e82-c57f8cfb6883 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:08.266630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:08.267719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:08.268707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:08.271491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 356/702] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:08.277260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:08.340180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb2f8-9209-44ad-a9f6-321da497b30e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.340812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb2f8-9209-44ad-a9f6-321da497b30e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.341328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb2f8-9209-44ad-a9f6-321da497b30e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.342977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 357/703] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:08.349160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.349449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.349731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.374202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:08.375558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:08.401967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:08.454551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf141-c3f7-4897-ae52-a13ba19ef2f9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:08.466805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 358/704] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:08.518737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:08.519359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.519640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.519912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.520686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:08.520993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:08.522449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:08.525574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:08.547695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 347/705] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:03:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:08.554263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:08.714842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2745-1ff1-4ec9-97b0-8850c016f2fa None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:08.792919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:08.793712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.793997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.794795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.834722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:08.881310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:08.895807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:08.897302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.090075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776753-c38d-45fa-862c-804b1f30aea5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.112942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 359/706] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:03:09.119163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.141209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.141910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.142195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.142469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] PATH_INFO: `/v3/services/network` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.143412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.144916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-98e43ea6-0362-4ba5-aeea-ecbf483c37cd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:09.164003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:09.165102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:09.165958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 348/707] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:08 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:09.166795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5499-3c34-411c-9ce3-f77214a0bd70 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.166795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5499-3c34-411c-9ce3-f77214a0bd70 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.166795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5499-3c34-411c-9ce3-f77214a0bd70 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.167521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 349/708] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:09.174715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.175048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.175249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.203730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:09.205997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:09.228352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:09.289560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:09.290909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1352-9f49-4031-956f-437f3f435464 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.312939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 350/709] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:09.314112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.340292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.342172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.342666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.343143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.362428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.364849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:09.398180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:09.399642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:09.400612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:09.400612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:09.400612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:09.400612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 360/710] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:09.407845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.520650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828dbf6-dfef-4b35-9e52-23e93e9073fb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.580660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.581639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.582122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.582624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.583540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] RBAC: Adding query filter params (name=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:09.584096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.585707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.592009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 351/711] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:09.597998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.598412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45af2b-b6a0-4748-acfa-2c6f3fe70811 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.631987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:09.637818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.638551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.638838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.639109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.640051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:09.640253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.641676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.656612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 361/712] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:09.662016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.698394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:09.767612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9f1e3-bcdd-4359-875f-eb3477bcda6d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.818987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70abd-70e6-44c0-a1c5-51d4b368c305 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:09.833297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.834601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.835115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.835784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.837148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] RBAC: Adding query filter params (type=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:09.837930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.839784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.855209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 352/713] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:09.856474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.859478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:09.860455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.860582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.860867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.874188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:09.875835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:09.893773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:09.894876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:09.895832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:09.895832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:09.895832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:09.900147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 362/714] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:09.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:09.929697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:09.998024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92574c-a335-410b-947b-148bbd49c20f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.019021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.039494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10d7e-eac9-4a5f-a72c-6bba9022269a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.042252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.043200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.043731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.044247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.052649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.054642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:10.069033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:10.069992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:10.070920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:10.073913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 353/715] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:10.084146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.086154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.086806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.087083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.087352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.088060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:10.088366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.089793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.122850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 363/716] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:10.124146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.268313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41977-0e66-4710-9e91-777646ad1e71 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.331029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.331655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.331930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.334440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.335211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:10.335521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.337034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.351353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.364602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 354/717] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:10.370333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.412306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c75c-6cde-4c10-8dae-e7468cfe2266 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.441405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.522389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.523424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.523908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.524434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.525647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.532970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da816b7-4b51-4b2d-add4-3db8ed5a8e70 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.592085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 364/718] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:10 2022] POST /identity/v3/users => generated 254 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:03:10.594713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91f11-f08f-451e-a067-dcaded5a68a9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.673773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.675383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.676346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.677212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.678542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:10.679234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.682214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb528a-751f-4d5c-a3cd-e0b9a8a024f7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.694457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 355/719] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:10.937016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502917-8032-4344-91f3-2b4c9099f7d4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.937287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502917-8032-4344-91f3-2b4c9099f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.937443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502917-8032-4344-91f3-2b4c9099f7d4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.939207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 365/720] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:10.945791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468c8c-a1d5-4e6a-8cc8-57fba2b8ab6a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.946212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468c8c-a1d5-4e6a-8cc8-57fba2b8ab6a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.946608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468c8c-a1d5-4e6a-8cc8-57fba2b8ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.974053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-11468c8c-a1d5-4e6a-8cc8-57fba2b8ab6a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:10.975292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-11468c8c-a1d5-4e6a-8cc8-57fba2b8ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:11.064443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 356/721] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:11.360166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502917-8032-4344-91f3-2b4c9099f7d4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:11.513797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8449-f681-41d5-a5a4-e212efa57bfd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.514337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8449-f681-41d5-a5a4-e212efa57bfd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.514593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8449-f681-41d5-a5a4-e212efa57bfd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.516394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 357/722] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:11.522125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502917-8032-4344-91f3-2b4c9099f7d4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:11.522709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.523087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.523516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.542885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:11.544369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:11.580485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:11.581116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.581389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.581656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.582346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:11.583753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:11.603789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:11.604379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:11.627123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 366/723] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:11 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:11.686122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 358/724] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:12.203364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:12.339518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a994-c88b-41a3-a8de-ec5a2e481758 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:12.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:12.411666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:12.412163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:12.412630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:12.432593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:12.442953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:12.444026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:12.444906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:12.445662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 367/725] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:12.455269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:12.659342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146664f0-230a-4426-8e66-82b8a9150e65 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:12.724530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:12.725419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:12.725884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:12.726340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:12.727548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:12.728117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:12.730661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8165-fc9f-4fbf-a8fe-ad0944520c69 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:12.747648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 359/726] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:12.757090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:12.860283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:12.919573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c82d8-9161-491b-9329-b3918c68140a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:12.961972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:12.963040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:12.963526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:12.964009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:12.977047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:12.977481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da841d3-69ca-4ac4-a731-05051327714a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:12.977764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da841d3-69ca-4ac4-a731-05051327714a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:12.978039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da841d3-69ca-4ac4-a731-05051327714a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:12.979571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:12.979697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 360/727] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:12.985400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:12.985718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:12.985951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:12.998544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:12.999594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:13.000514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:13.000514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:13.000514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:13.002786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 368/728] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:13.009224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:13.011098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:13.011382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:13.050310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:13.134996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080ccc-37ae-4b02-b366-04911de36f84 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:13.146865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:13.182237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:13.183363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.183833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.184435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.185299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:13.185790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:13.187480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:13.205699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 369/729] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:13.218378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 361/730] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:13.222457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:13.471054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410c9c-d3e5-4276-9c13-a32abb0135a0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:13.496235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:13.522598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:13.523636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.524142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.524660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.533177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:13.535093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:13.549114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:13.550200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:13.551130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:13.554452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 370/731] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:13.564058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:13.648854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:13.767329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dddef-21ea-4339-9ab0-3a444f659495 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:13.837511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6f2f9-9157-4d7d-beb3-b743e960af8e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:13.858365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:13.859419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.859918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.860439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.861333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:13.864724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2227cf-f9d9-489b-b08f-1af52ce78cfe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:13.901496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 362/732] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:13 2022] POST /identity/v3/services => generated 240 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:13.908060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f58-0578-4fac-9233-edac0e704c92 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.908733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f58-0578-4fac-9233-edac0e704c92 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.909228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f58-0578-4fac-9233-edac0e704c92 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.911887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 363/733] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:13.919041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25d9e-c899-4074-80c4-be35323ea167 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.919778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25d9e-c899-4074-80c4-be35323ea167 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.920282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25d9e-c899-4074-80c4-be35323ea167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.959913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7ec25d9e-c899-4074-80c4-be35323ea167 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:13.961671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7ec25d9e-c899-4074-80c4-be35323ea167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:13.965385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:13.978479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:13.979185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.979494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.979760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.980599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:13.980902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:13.984792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:14.035307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 371/734] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:03:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:14.041127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:14.151784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 364/735] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:14.203175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:14.234931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777eac8-3150-4afc-acb5-4cfe78d4100a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:14.294640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:14.295429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.295811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.296277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:14.424775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:14.427510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:14.513782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28d23-cd1f-4722-9a74-f217f75fa2cd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.514159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28d23-cd1f-4722-9a74-f217f75fa2cd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.514331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28d23-cd1f-4722-9a74-f217f75fa2cd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:14.516073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 365/736] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:14.529522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.529863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.530064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:14.580718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:14.582573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:14.625595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:14.680075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 372/737] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:14.680075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:14.724029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 366/738] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:14.725207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:14.863861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b22-7998-4cf2-9272-f0694b3e8a31 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:14.934812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:14.977546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:14.978477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.978885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.979274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.018918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:15.030732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:15.031759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:15.032733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:15.035984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 373/739] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:15.040701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.068032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f635-fd14-40d8-b28b-e6dd1aad0c7f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.116053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:15.136842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.137837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.138122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.138393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.156754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.159379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.193252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e051-d0e8-4280-94af-5b625162fb4f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:15.209105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:15.210161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:15.211101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:15.211101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:15.211101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:15.220074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 367/740] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:15.220074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.261559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.262536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.263007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.263431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.264683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:15.265204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.267770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.296104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 374/741] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:15.298015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.361954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0112d-cbc8-420f-b41c-2ff2e6fdd7b1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.400403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:15.427995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.429013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.430031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.430470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.439211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692fd52-6dbf-4e31-a6b9-c15a2c09cd4f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.442084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:15.450639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:15.461232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:15.463010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 368/742] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:15.465659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.490826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.491571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.491815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.492605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.493234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:15.493564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.494906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f20d8-2bbb-4e10-8051-8793ee960169 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.508867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 375/743] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:15.514348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de7bc-1eb4-448b-b3c8-8d866fc2ee68 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.514743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de7bc-1eb4-448b-b3c8-8d866fc2ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.515184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de7bc-1eb4-448b-b3c8-8d866fc2ee68 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.520119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 376/744] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:15.521196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de7bc-1eb4-448b-b3c8-8d866fc2ee68 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.630673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8b7b-f5ae-47a5-aadc-d204d4b91efd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.662256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de7bc-1eb4-448b-b3c8-8d866fc2ee68 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.676904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.677549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.677825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.678091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.691594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.693230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:15.712070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:15.713204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:15.714245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:15.714245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:15.714245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:15.714245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 369/745] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:15.714245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.735042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.736024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.736464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.736886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.737992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:15.738461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.740850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11a594-5ac8-475e-89a4-712996c650d8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.756477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:15.756870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 377/746] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:15.758977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.759468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.759825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.791393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:15.793333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:15.834185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:15.855013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b56fd-6894-49df-85aa-e5ac921e423a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:15.909446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:15.910271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:15.910554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:15.910841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:15.928082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 378/747] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:15.928082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:15.928749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:15.928749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:15.950031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:15.952728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 370/748] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:15.955524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.099090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaaa52-d50c-4989-9321-ff519b686bff None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.133721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:16.148191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.148541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd90a-8401-4cfe-a303-eaaf842bed98 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.149245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.149685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.150154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.151028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:16.151745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.153334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.171380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 379/749] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:16.172611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.203581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:16.248888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.250176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.250639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.251102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.270935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.273733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.298973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8127c-cda4-4b58-abdc-3f9cd0abcb4c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:16.301167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:16.302389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:16.303417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:16.303417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:16.303417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:16.303746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 371/750] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:16.306356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.370649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.372333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.373131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.373842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.375341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:16.376295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.379257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.404797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 380/751] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:16.406655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.440533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ea58-ace6-4b01-87c6-970afa4d8e3e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.481032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.481556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.481833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.482104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.491910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.493462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:16.507137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:16.517044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 372/752] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:16.519168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.522841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:16.574721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:16.603856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a7a4-f218-4af9-908a-13135d2e9782 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.659582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.660599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.661044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.661485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.662280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.665244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.681591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4415-e04d-4004-b7ab-cb171eb7b561 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:16.685623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:16.686683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:16.687530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 381/753] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:16.688859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.727210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.727860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.728160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.728434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.729114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:16.729414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.730883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.744959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 373/754] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:16.745766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.815655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:16.854317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4a4-d151-4fe1-9adc-ad0036a4b9fb None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.865610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d459-f0e7-4228-8703-be09de2f7103 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:16.901215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.901833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.902199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.902546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.903352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:16.903855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:16.903999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.904252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.904356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.904517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.905244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:16.905542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:16.906048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50d1e0-01ca-409f-b22d-92670474c54b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.906962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:16.916808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 382/755] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/role_assignments?user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:16.918767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887e3c-23f6-48e5-a8b2-7f4e6e6c8345 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:16.919252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887e3c-23f6-48e5-a8b2-7f4e6e6c8345 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:16.919727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887e3c-23f6-48e5-a8b2-7f4e6e6c8345 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:16.924048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 383/756] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:16.924048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd887e3c-23f6-48e5-a8b2-7f4e6e6c8345 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.931666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 374/757] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:16.932885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:16.933622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.073440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd887e3c-23f6-48e5-a8b2-7f4e6e6c8345 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.087813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65c8a-a3e1-48fd-8a80-3dcdebcce5e0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.117692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.118315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.118586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.118850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.119716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:17.120055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.121898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336876-e08d-44ae-a81e-4bd641df96b6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.133389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 384/758] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:17.133389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.133389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.133389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.134558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.154135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:17.155434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:17.156393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.157761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.157761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.157761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.165807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.170916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:17.184891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:17.186084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:17.186999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 375/759] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:17.187583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.244726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.253953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 385/760] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:17.254826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.330237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a22e-d66c-4328-88ae-789cd031d00f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.374907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.375549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.375814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.376137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.390314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.392003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:17.410701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:17.413027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:17.414912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:17.414912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:17.414912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:17.414912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 376/761] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:17.414912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.435256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc5b3-8201-4274-86fd-175928a6d476 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.459872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.496513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.497130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.497397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.497667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.498295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:17.498599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.500449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.512410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 386/762] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:17.513385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.585384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.591168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd0d5-ad64-470f-9966-bc58ed956e09 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.634501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704beb-f526-4400-86ec-a5b7c9b5c895 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.639998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.640639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.640918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.641172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.641923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:17.642222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.643808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.664158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 377/763] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:17.665111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.709928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.710856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.711288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.711714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.712816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:17.713290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.715595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.736193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 387/764] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:17.737605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.804602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.825852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b492-a4e7-427b-9fce-c1e9a5185f7a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.880955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.881910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.882093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.882403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.883512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] RBAC: Adding query filter params (interface=public, service_id=5e957498cc104276856af530e215a908, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:17.883952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.886276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.897643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61aeef-d021-4ded-bd36-94e79ae56385 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:17.903809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 378/765] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/endpoints?service_id=5e957498cc104276856af530e215a908&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:17.903809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:17.947211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:17.965783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:17.966773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:17.967210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:17.967631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] PATH_INFO: `/v3/services/network` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:17.971887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:17.971887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:17.987245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:17.988348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:17.989208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 388/766] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:17.991600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.068727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a99df-36f3-4732-a6ae-afacd57231a6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.114255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29b0-bff8-4e83-80b0-e6d275437a46 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.114464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.115474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.115851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.116023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.147206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.171085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.171752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.172074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.172407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.181482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.183287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:18.196774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:18.198677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 389/767] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:18.205550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.216052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.217629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.260375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.345239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64776435-4d43-45b7-a3d4-dad43e7e4bc7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.389822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 379/768] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:18.389822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.406876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.407378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.407651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.407919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.408546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.409890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.424399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 390/769] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:18.424399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.486356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.558446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3ed8-7a25-4904-80e1-3e54e4305e69 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.585296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ee83-ef22-4c66-8203-4603f1ccc718 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.600545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.630606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.631798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.632128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.632398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.633075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:18.633374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.635273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.639434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.641028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.641401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 380/770] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:18.642218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.642573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.643656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.646865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:18.648471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.651514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.678075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 391/771] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:18.679779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.808933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5ee7-0e5a-4d6e-9913-606812930bd6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.828703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7186351-7ea3-40e1-863f-7fb7fd76acb7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.855920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.868335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.869200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.869692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.870137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.870945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:18.871433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.873138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.879597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 392/772] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:18.880824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.882184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.883081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.883641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.884519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.908097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:18.911375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:18.921107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:18.948790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:18.949775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:18.950652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:18.950652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:18.950652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:18.951829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 381/773] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:18.953738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.012162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7618a-17ea-4912-96a0-73f8a66ab4a4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.054267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.055434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.055919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.056396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/83fb245122344892b0377532854af000` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.058972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=056e6c0714cf4827a3b118d0bddfb182, role_id=83fb245122344892b0377532854af000)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.060714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.078345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 393/774] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:18 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:19.079562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.155157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ee56-f792-40ac-b8f0-4049238cb51e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.242441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.243014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.243288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.243558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.244556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] RBAC: Adding query filter params (interface=public, service_id=91675175fc3f4ed1a4395d1e39590dc8, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:19.244918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.246321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.264368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 382/775] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/endpoints?service_id=91675175fc3f4ed1a4395d1e39590dc8&interface=public®ion_id=RegionOne => generated 194 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:19.269717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.277165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.292781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff960bb-0d2d-44d2-98ec-c144cf99a4bd None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.362683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.363721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.364315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.364809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.365745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:19.366271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.368076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.382902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 394/776] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:19.385259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.391935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.500871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47baae4-bf05-483f-a661-21a715ccfc5b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.544841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.545589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.545960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.546337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.547075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.548601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae710b4-d482-4cc2-bd45-98c73466b08e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.555519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 383/777] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/services => generated 772 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:19.588603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f621dc-5022-41b7-99ce-7a919e642df4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.588925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f621dc-5022-41b7-99ce-7a919e642df4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.589153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f621dc-5022-41b7-99ce-7a919e642df4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.590665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 384/778] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:19.601916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.602258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.602460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.607359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165fcc-aca5-4851-bde4-07d38a0d5e20 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.639999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:19.641261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:19.711468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.712545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.712988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.713429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.731289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.734230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:19.760943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:19.761960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:19.762856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:19.763267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 395/779] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:19.768929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.814403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.832820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 385/780] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:20.019746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e00af3-5c8f-4f2b-a854-ca19116b353f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.074996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.075625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.075906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.076206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.076913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.077218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.078663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.093445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 396/781] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.100843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.141151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.187496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.277409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.312309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd6e05-144b-4c56-92bf-d032f29c15ad None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.331684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab59a-a055-4130-a5c9-112d86a7aad0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.366355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.367404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.367905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.368401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.411755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:20.422338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:20.423361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:20.424208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 397/782] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:20.431550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.451631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.452695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.453176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.453671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.454625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=550e5809b04c434daf6144e4b6cc3517) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.455823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.458132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.479405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 386/783] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/role_assignments?user.id=550e5809b04c434daf6144e4b6cc3517&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.673925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a340a-c585-404d-a44f-9a19de28e197 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.745684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.747122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.747880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.748516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.749876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.750646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.753034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.756289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.772362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 398/784] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:20.778693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.960001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.973987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702e7e-b09d-4e7b-bed7-b17de2dc337b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.039328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.040675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.041341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.042128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.063594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.067626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:21.097055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:21.099065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:21.101146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:21.101146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:21.101146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:21.104136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 387/785] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:21.113765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.312504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a721-7738-438f-8a0f-f3ba5c9f3143 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.367877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.368541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.368824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.369097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.369769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:21.370074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.371470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.386595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 399/786] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:21.397525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.572967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6abb-1286-4ce2-a267-df1b51a31547 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.625739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.626397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.626676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.626953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.636104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.637761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ee3a5e00-ce7f-4e5c-af04-323f59fcb51f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:21.655777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:21.658264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:21.660674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 388/787] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:21.669140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.749622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65217f-557c-487a-b6a8-77cc8b2ca803 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.750051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65217f-557c-487a-b6a8-77cc8b2ca803 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.750247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65217f-557c-487a-b6a8-77cc8b2ca803 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.751940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 389/788] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:21.757286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.757674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.757910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.781158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.786280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.795939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:21.797378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:21.875158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95cd0-d9c9-40d1-bc8d-964d9c6be37d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.961581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 390/789] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:22.086483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.087132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.087406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.087670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.088499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:22.088801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.090328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2b9ef-a525-4026-88af-c0aa39fcadfe None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.123755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 400/790] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:22.129736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.220337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67253898-bc21-4675-9512-e8462851aba9 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.220682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67253898-bc21-4675-9512-e8462851aba9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.220969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67253898-bc21-4675-9512-e8462851aba9 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.223248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 401/791] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:22.228802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.229080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.229343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.259349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:22.260797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:22.300170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14ea4c-2991-4ea5-b413-fa541dde6d4d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.373976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.374631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.374910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.375181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.388449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:22.395276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.397019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.399059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 402/792] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:22.400072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:22.422400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:22.423733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:22.424722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:22.424722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:22.424722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:22.429178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 391/793] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:22.435974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.460617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:22.539367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df421-e696-402a-907e-d8bf969df0c6 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.594452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0375-4125-438c-9f65-e8baefda0a62 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.594997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.596053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.596476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.596931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.597867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.599936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:22.615188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:22.617617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:22.619709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 403/794] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:22.626042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.667787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.668348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.668666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.668977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.669820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:22.670325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.672866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.699853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 392/795] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:22.709734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.803131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:22.809572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220dfd6-fc06-486a-a288-92a860552fc8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.820656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:22.849828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.850456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.850727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.851029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.851738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:22.852090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.853544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc78f43-9307-42fb-860c-8fc34b30f9fa None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.859741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 404/796] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:22.861197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c05d-8081-48b1-bc81-ab5f6734e7b0 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.861502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c05d-8081-48b1-bc81-ab5f6734e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.862334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c05d-8081-48b1-bc81-ab5f6734e7b0 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.864217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 405/797] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:22.865014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3c05d-8081-48b1-bc81-ab5f6734e7b0 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.876262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a99e7-23f2-449b-8b36-2fc9ca6df65f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.915255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.915904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.916218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.916490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.924886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.926280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bf02131e-2e7a-406e-b76a-522b1b240d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:22.938757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:22.939740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:22.941511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 393/798] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:22.942472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.942635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.942876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.961850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:22.963079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:22.992478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3c05d-8081-48b1-bc81-ab5f6734e7b0 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.041119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.042217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.042609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.042886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.051865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 394/799] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:23.051865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.058516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:23.064390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:23.065708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:23.066639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:23.067272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 406/800] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:23.068135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.112451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.141115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.231827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17eeb50-6b81-43f9-b607-176ff0af9880 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.271944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8d0c3-c2e8-4ff0-a2ac-261f477c48cb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.288384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.289780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.290795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.291319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.292829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:23.293375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.296296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.315415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.316318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.316999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.317413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.318287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:23.318757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.324597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 407/801] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:23.324597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.325313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.332723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 395/802] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:23.333954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.476777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.492090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f571-b105-4196-8499-1c9fc91ad225 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.497516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19c2e-9a87-4284-84ac-9a19fe2dae8e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.499436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.550519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.551181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.551456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.551722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/8f7865ffcaff4e8e8bdd7ceac7b27c3d/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.551928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.552830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.553230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.553618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.553724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=8f7865ffcaff4e8e8bdd7ceac7b27c3d, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.554596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:23.555043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.555150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.557125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.579994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 396/803] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:23 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/8f7865ffcaff4e8e8bdd7ceac7b27c3d/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:23.579994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.580782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 408/804] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:23.580782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.744314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53013c75-e9f1-4a8b-8b18-980cb7ffdc84 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.762774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bfc2-0f2b-42de-80a4-7b61266ad2e9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:23.800535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.801186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.801458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.801725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] PATH_INFO: `/v3/services/network` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.802317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.803696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:23.815115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:23.816203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:23.817367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 409/805] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:23.818162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.819320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:23.820025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.820318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.820589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.821291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:23.822698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4396-fd67-4392-bfa4-83569555bf7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:23.850214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.851361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 397/806] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:23.853646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6041-f18a-420a-bd68-b7ed47e7b8bc None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.854118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6041-f18a-420a-bd68-b7ed47e7b8bc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.854584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6041-f18a-420a-bd68-b7ed47e7b8bc None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.862432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 398/807] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:23.862432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6041-f18a-420a-bd68-b7ed47e7b8bc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:23.889968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.015546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46cb8-d3b3-4ff0-9d04-7a69a9aa3534 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.086477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6041-f18a-420a-bd68-b7ed47e7b8bc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.094473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.096112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.096889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.097623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.121654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.124919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.153280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.154295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.154727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.155164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.156350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:24.156856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-55d5f236-91db-4cfb-a12e-12129cf684ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:24.159276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:24.161016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:24.162645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:24.162645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:24.162645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:24.162956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.166089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 410/808] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:24.167891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 399/809] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:24.169329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.170207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.170954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.180947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.210547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:24.212374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:24.315000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.343851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3629-a423-40c5-9c30-711f75f7e2f7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.366022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.383817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 411/810] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:24.386003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.402844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.403891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.404469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.405022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.406216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:24.406741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.415993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.453249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 400/811] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:24.461493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.643560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3e82-b11a-4aa7-ad51-7a3060e26f49 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.712065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.713052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.713566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.713975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.719447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] RBAC: Adding query filter params (type=network) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:24.719447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.719447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.729584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 412/812] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:24.742310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.768093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94377-c73f-4222-9c8f-758e4dcd5cd2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.828337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.847884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.848587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.848865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.849139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.858194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.860269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.866422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:24.882224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:24.883238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:03:24.884231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:24.887358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 401/813] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:24.888527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.926851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229becc-da77-4f21-b187-1ac5d7769633 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.994976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.995844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.996165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.996432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.997192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.998624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.036191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 413/814] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:25.036894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26247-0493-4231-a4cd-47d81541c33d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.037217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.091297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.092345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.092828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.093590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.117872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:25.125063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:25.126663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:25.127644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:25.131495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 402/815] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:25.138394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.220084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.291483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c65ea-4145-4dec-9102-55d2aed1cb6f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.349315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.350317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.350829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.351300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.352432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:25.352957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.354908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.366729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 403/816] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:25.370716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a235f-8639-4fdc-a28b-ba7e83841e82 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.374758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.416285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.451149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.452375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.452866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.453337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.454876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:25.455744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.458604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.499926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 414/817] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:25.506428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35ded-79cb-4fee-bfe4-46476a177f41 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.509144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.526983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.554302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.555379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.555871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.556658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.571857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.574275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:25.593065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:25.594055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:25.595483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:25.595483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:25.595483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:25.598235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 404/818] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:25.605030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.720994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081743e-fc27-4ec7-ac15-d7a5fa2b4d5c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.742158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5416b-f8ca-4ba1-8f89-64e7580d0443 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.764911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.765455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.765740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.765988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.784595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.785904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.786383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.786894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.787804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:25.788351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.789989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.809580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 405/819] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:25.810981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.834294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.847836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.860024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.861614 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.934114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620828c3-d3f5-49fc-8c1a-a77b28279239 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.979109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.980276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.980785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.981256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.990196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 415/820] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:25.990901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.996244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.002304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:26.009344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:26.010434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:26.011356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:26.015747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 406/821] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:26.017281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.111677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.142050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1216-0366-4ea6-864e-a6b56787154c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.165619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.185449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4ef-e32a-4f9c-ad83-466b7a4c909c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.206282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.206950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.207211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.207523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.222880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.225293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.229508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.230571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.231048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.231515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.232534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:26.233047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.234816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3b5a8-4edd-488b-b147-d8f45658a9f2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-0b104584-e7b8-4a04-9c4c-b51e4b5e2204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:26.244615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:26.246529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:26.248975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:26.248975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:26.248975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:26.248975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 416/822] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:26.248975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d791a1-a76c-4964-99e5-49b3b56fe60a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.249563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d791a1-a76c-4964-99e5-49b3b56fe60a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.249563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d791a1-a76c-4964-99e5-49b3b56fe60a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.251998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 417/823] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:26.255490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d791a1-a76c-4964-99e5-49b3b56fe60a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.259560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 407/824] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:26.261393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.261678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.261952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.284176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:26.285320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:26.369438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 408/825] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:26.370320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.433542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d791a1-a76c-4964-99e5-49b3b56fe60a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.461616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.489575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a556eb-4cc7-4c9a-ab13-c913c4bcc37f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.496546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.508841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.510442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.511318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.512244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.513760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:26.514584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.517541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.530912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.531595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.531871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.532160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.543889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.545355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.549908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 418/826] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:26.556115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:26.564166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:26.565295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:26.566181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:26.566181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:26.566181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:26.566181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 409/827] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:26.579119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.683987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41802d-ce55-4cb0-92eb-55137bf13c33 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.737346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.738159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.738554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.738941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.748169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.749896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:26.769864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:26.771591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 419/828] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:26.773362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.790420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e58d7a-c440-4b0c-9f44-db5e25a6a232 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.829726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.840979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.841978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.842319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.843176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.843376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:26.843746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.845545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.858714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.869353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 410/829] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:26.869353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.932399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1d91b-3c66-4e86-a700-31d93b791fd1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.984516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.985147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.985424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.985692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.997277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:27.003370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:27.004532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 420/830] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:27.005374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.015036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee67f9-bc43-453b-82aa-316643ae5476 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.069406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.070208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.070600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.070987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.071855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.072301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.073875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26607-e889-4bbb-adfc-cddcafbbcad4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 411/831] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae012b4-c9f2-4ec6-8049-c24572de4c5e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae012b4-c9f2-4ec6-8049-c24572de4c5e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae012b4-c9f2-4ec6-8049-c24572de4c5e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 412/832] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:27.094510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae012b4-c9f2-4ec6-8049-c24572de4c5e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.147005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55ffa-3562-4046-be7d-82d3d86f1e56 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.150057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.163384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.198848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.199649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.200124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.200563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.211883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.213549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:27.226425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:27.228404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 421/833] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:27.230025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.236208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae012b4-c9f2-4ec6-8049-c24572de4c5e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.280253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.280901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.281220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.281496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.282200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.282526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.283940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ad9b-664e-4880-a8b5-c993516935b3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.294917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 413/834] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.296460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.297321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.297564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.322097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:27.324199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:27.375925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8f4a7-01a5-43ed-98b3-6b722c786578 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.418560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.419344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.419722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.420022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.421230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.422318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.425104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.429234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 414/835] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:27.430670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.435474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 422/836] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.437068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.529280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.540764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.663491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d01b-f0a2-4b03-a735-334a3edd51a3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.668513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b6e7-fbbb-4297-b76d-3d7e903b0f3d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.727438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.728682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.729318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.729911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.731351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.732048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.734855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.738248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.738920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.739164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.739434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.753151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.754608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.758723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 415/837] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.760828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:27.774407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:27.776686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:27.778794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:27.778794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:27.778794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:27.778794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 423/838] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:27.778794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.922408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.945576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e4f6f-93c8-41a5-b326-ae2abd01351c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.996004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.997140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.997625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.998073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/550e5809b04c434daf6144e4b6cc3517/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.019554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=550e5809b04c434daf6144e4b6cc3517, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.021102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.047997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 424/839] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:27 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/550e5809b04c434daf6144e4b6cc3517/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:28.047997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.089317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.101111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f33-2e9e-411e-8be8-0b75ef2e9e52 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.156575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.157782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.158210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.158626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.159534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.161304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:28.171681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:28.172870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:28.173793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:28.182327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 416/840] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:28.183700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.217199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6c6-df10-40b0-8827-be1a87867cbc None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.277794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.279071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.279560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.281783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.283528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:28.284090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.286307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.291494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.315506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 425/841] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.321977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.386087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8b897-d110-4ab9-9019-cb41ed1f5e6e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.453455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.454177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.454502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.454819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.455677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:28.456035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.458131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.467560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 417/842] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.474636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6948b9-3614-432b-b358-63baa4d802ce None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.476752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.529173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.560620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.562560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.563233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.563880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.581137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.585309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:28.606104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:28.607320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:03:28.608525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:28.612304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 426/843] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:28.614241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.648403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb48-c593-484f-a2da-502cea4e6a81 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.684168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.692984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.693912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.694339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.694752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.695568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:28.696075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.697863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.706379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 418/844] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.749211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c03d-48f4-4b29-be6f-5cf3e89ee650 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.793927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.794731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.795159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.795434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.796362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:28.796674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.798183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.820472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 427/845] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:28.826010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.956250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.967520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529f65-295c-4d41-be8f-d03743e8d1cf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.023175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.024245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.024724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.025198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.110849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.113331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.236452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:29.249691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 419/846] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:29.257315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.392789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6703-8bbd-4f0e-a7e9-bd7659db9a59 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.425055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:29.462959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.464629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.465338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.466026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.485397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.489266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:29.519139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:29.520940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:29.522630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:29.522630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:29.522630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:29.526065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 428/847] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:29.535998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.664724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a564-900f-4535-8c19-8016947c34cd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.703946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.704595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.704872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.705139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.705793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:29.706089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.707452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.720093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 420/848] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:29.725473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.848386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662137be-9519-4f9b-94f6-4dd1a007ee19 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.885159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.885795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.886068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.886334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.894022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.895458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:29.908193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:29.909158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:29.910035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 429/849] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:29.915645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.985059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.063443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb10a69-76d4-483e-a00c-c616a20ccdb4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.124243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.125296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.125627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.126044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.127389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:30.127892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.130626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974e04-f889-4817-a59a-a5d4b518dd99 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:30.149469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 421/850] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:30.157206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.179136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a42a-ddec-4044-b750-3a4f10d4b074 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.179540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a42a-ddec-4044-b750-3a4f10d4b074 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.180217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a42a-ddec-4044-b750-3a4f10d4b074 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.181929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 422/851] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:30.188526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.188838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.189065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.208488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:30.210635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:30.211578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.293707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285556f1-a928-4aa1-afad-4c3cc63092e1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.297334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 423/852] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:30.331718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.332749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.333222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.333684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.334595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:30.335093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.336789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1cabe-bb96-4ee2-bb79-6eb91014cc13 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:30.344079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 430/853] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/role_assignments?user.id=8f7865ffcaff4e8e8bdd7ceac7b27c3d&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:30.572125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.621828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.634741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f81ec-6a1e-4a18-aaf0-592a36c38d03 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.635262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f81ec-6a1e-4a18-aaf0-592a36c38d03 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.635675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f81ec-6a1e-4a18-aaf0-592a36c38d03 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.640331 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 431/854] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:30.647195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44d49-4753-4285-a000-6253e754f31b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.647659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44d49-4753-4285-a000-6253e754f31b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.648173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44d49-4753-4285-a000-6253e754f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.680313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-aff44d49-4753-4285-a000-6253e754f31b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:30.682340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-aff44d49-4753-4285-a000-6253e754f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:30.687368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e68fa-4665-4185-a8be-04e865a40c48 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.725260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.726271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.726820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.727303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.728286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.729907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:30.740738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:30.741765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:30.742650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:30.747053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 424/855] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:30.753893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.791015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 432/856] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:30.880455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c9a65-a04f-4c68-ae28-c56601261b99 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.888349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.917074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.917686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.917961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.918230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.918875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:30.919173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.920616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:30.925745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 425/857] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:30.931415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff44d49-4753-4285-a000-6253e754f31b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.956038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.047252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff44d49-4753-4285-a000-6253e754f31b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.083267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.083898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.084207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.084475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.085132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:31.085434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.086844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac192d-29dd-4d9b-bf6a-768500b8def3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.093348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 433/858] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:31.199728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.245278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62e01-e945-4947-98c5-5dfd4e41012e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.245538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62e01-e945-4947-98c5-5dfd4e41012e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.245815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62e01-e945-4947-98c5-5dfd4e41012e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.254314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 434/859] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:31.256944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.257431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.257893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.286792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:31.287989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:31.338599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d45f7-a22b-4cd7-a714-08fb837520a9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.378568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.379591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.380157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.380632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.387616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 435/860] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:31.396227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:31.401940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:31.403097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:03:31.404204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:31.406741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 426/861] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:31.416165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.432757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.534229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ebf46-6dae-4808-b550-e0ea90aa4524 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.571615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.572301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.572578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.572846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.573549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:31.573844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.575397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.585599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 436/862] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:31.592248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.635277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.672239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.731165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27540-a39d-4267-838f-7e9082a39394 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.793233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.794555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.795157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.795761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.802764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.820624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.823919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.840905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475c85-a817-4fb5-acf7-510abd2fd248 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:31.855530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:31.857852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:31.859675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:31.859675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:31.859675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:31.863546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 427/863] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:31.870722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.900354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.902065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.902667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.903153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.905508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.908225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.941695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 437/864] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:31 2022] POST /identity/v3/services => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:31.985690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.008840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075fa4c-8e00-4831-bc40-b982c2fb0f55 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.059110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.060295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.060587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.060918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.061592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:32.061894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.063302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.088190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 428/865] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:32.093217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.244115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d250c-08f9-4f58-8f52-cb90d36b801f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.292867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.293516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.293792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.294124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.297860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.304611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.306062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:32.321552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:32.323535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:32.325553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:32.332197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 438/866] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:32.332917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.446775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1545-6b4c-42b2-91c6-66397833c7c7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.489019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.489658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.489936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.490210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.490987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:32.491296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.492820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b053b5-00c9-4e1c-98b2-cb89fbb1c4e8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.502817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.519914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 429/867] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:32.521428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.660146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2843ab-0bea-4648-afcd-b7006b9b23f0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.727248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.727248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.727248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.727248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.814920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2224-7a22-4c4d-aeb9-01663c94c487 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.815237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2224-7a22-4c4d-aeb9-01663c94c487 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.815492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2224-7a22-4c4d-aeb9-01663c94c487 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.817343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 430/868] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:32.822850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.823119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.823383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.831623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.846127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:32.847623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:32.852062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.853860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.940446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 431/869] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:32.986809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 439/870] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:32.988998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.144754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39cfbd-66f5-477b-8ba3-89851a44725e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.179841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.193442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.194560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.195099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.195609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.209702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.211713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:33.230490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:33.232200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:33.233217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:33.233217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:33.233217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:33.235545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 432/871] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:33.241222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.294449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.352333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.366248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e6c3-2079-4c5e-83f4-f4a3036587f4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.439386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.441220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.441575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.441851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.443347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:33.444644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.445377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.450973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09837-968b-4068-bed7-1335934c0cde None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.468718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 440/872] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:33.470272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.558987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.560780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.561094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.561345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.561931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.563364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:33.588686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:33.591129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:33.592802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:33.595906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 433/873] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:33.600802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.627710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2581-2b8e-40d3-93ae-37eed467093f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.657667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.672072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.672714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.672985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.673249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.681368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.682816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-46442b73-832e-42cb-878f-86da6c5e7775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:33.696967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:33.697898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:33.698803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:33.700566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 441/874] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:33.702435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e4a9-ad72-4702-b550-d908aed19679 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.703133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e4a9-ad72-4702-b550-d908aed19679 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.703571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e4a9-ad72-4702-b550-d908aed19679 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.705148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 442/875] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:33.709503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779e4a9-ad72-4702-b550-d908aed19679 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.737356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.747884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625c6b-4391-4a7d-9a98-da58071b2e55 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.793246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.794631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.795086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.795482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.796472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:33.796978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.798569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bb923-1b7a-4372-a556-4c3a84281254 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.804699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 434/876] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:33.806751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.807223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.807682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.831148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:33.832391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:33.862901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779e4a9-ad72-4702-b550-d908aed19679 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.903339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.904655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.905219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.905532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.906466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:33.906810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.908285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.921746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 443/877] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:33.927454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 435/878] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:33.927848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.928261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.970200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.050647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.055274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29c62f-8b88-436c-8f9e-e1ba493763fe None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.080405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2ca0-74a1-45fe-8fbe-5f7b8817e06b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.104171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.105393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.106033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.106671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.108139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=550e5809b04c434daf6144e4b6cc3517) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:34.108895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.111128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.119726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.120511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.120846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.121032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 436/879] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/role_assignments?user.id=550e5809b04c434daf6144e4b6cc3517&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:34.121198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.128016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:34.128016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.128016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658e14f-c191-420a-ac10-c5c42fb7ec1b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.133644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 444/880] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:34.231832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.358122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.361957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb314516-3542-4db4-a00e-b6af56a6cd5a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.410299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.410907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.411182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.411446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.412142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.413522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef984-2d06-4af5-b4bb-6b2909b9d885 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.433755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 437/881] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:34 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:34.578448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a27-6bb0-407a-bb99-4b32f72b5e13 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.578755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a27-6bb0-407a-bb99-4b32f72b5e13 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.579000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a27-6bb0-407a-bb99-4b32f72b5e13 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.580881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 445/882] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:34.587237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.587785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.587785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.613097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:34.615204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:34.739432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 438/883] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:35.039308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793a27-6bb0-407a-bb99-4b32f72b5e13 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.150336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793a27-6bb0-407a-bb99-4b32f72b5e13 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.189935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.190901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.191373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.191814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.192591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.194134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:35.205189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:35.206271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:35.207139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:35.215776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 446/884] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:35.219637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.317956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.336087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad51292-8085-4d9c-bc54-a9ce6037ce8b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.375850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.376773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.377202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.377623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.378465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:35.378923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.380530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.391065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 439/885] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:35.392707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.396858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.545258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c69d-4c4d-4dec-a951-500c8fb619ec None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.592355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.593318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.593799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.594271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.595215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:35.595717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.597383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.607323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 447/886] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:35.610612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.725139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de799e-98bd-4f67-a3de-6a06daa3d7b9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.765773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.766775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.767255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.767728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.768753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] RBAC: Adding query filter params (interface=public, service_id=5adeaacf3318452da6b0c68d01a1ce4f, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:35.769320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.770930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7a71b-05d1-4804-a50b-a6cb30b67577 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.782992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 440/887] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/endpoints?service_id=5adeaacf3318452da6b0c68d01a1ce4f&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:35.784964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.869047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.908894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b10d1-4b9b-468b-a41b-36d01d46d20f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.946890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.947514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.947787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.948101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.948728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.950088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a2dae-b216-44bc-9f24-f13a66b43d94 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.956853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 448/888] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:03:36.773831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd647a3-50b7-4a3f-93ba-48b81bed6d15 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.774553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd647a3-50b7-4a3f-93ba-48b81bed6d15 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.774553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd647a3-50b7-4a3f-93ba-48b81bed6d15 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.776073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 441/889] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:36.782277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779101f-865e-4196-898b-349d2a5c4cad None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.782975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779101f-865e-4196-898b-349d2a5c4cad None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.782975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779101f-865e-4196-898b-349d2a5c4cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.795099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8af7-948f-4371-a34e-8f2ce41dcfb7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.795424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8af7-948f-4371-a34e-8f2ce41dcfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.795719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8af7-948f-4371-a34e-8f2ce41dcfb7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.798170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 442/890] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:36.804259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-6779101f-865e-4196-898b-349d2a5c4cad None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:36.804909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.805193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.805465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.805571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-6779101f-865e-4196-898b-349d2a5c4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:36.833890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:36.836375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:36.855818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:36.911996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 449/891] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:36.911996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b37e9-50dd-4376-9615-422066f1f5dd None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.911996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b37e9-50dd-4376-9615-422066f1f5dd None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.911996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b37e9-50dd-4376-9615-422066f1f5dd None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.911996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 450/892] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:36.917753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.918311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.918744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.950235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:36.952239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:36.955860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 443/893] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:37.090161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.111142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 451/894] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:37.213089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.270065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.365277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d963-7233-4f21-8c3d-a03effcbe460 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.416133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc3504-3de1-46fd-9f2a-c88415a75e3f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.420643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.421514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.421881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.422186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.422834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.424399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:37.437693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:37.438659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:37.439524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 444/895] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:37.447163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.464927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.488219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.489335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.489835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.490347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.505149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:37.512403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:37.513419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:37.514230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:37.517275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 452/896] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:37.528085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.597892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.642379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac885c-9b32-4734-baee-2077387bd101 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.675405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f94e-d36f-48b5-a609-3f4dabccc496 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.686556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.687738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.688081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.688554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.689724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.690260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.692866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.701093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 445/897] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:37.702437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.736209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.737210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.737683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.738176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.739419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.739948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.742599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.762498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 453/898] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:37.762498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.827066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.878828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac81d-cc51-4781-8d66-ec41283843b8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.892517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad41af-7b7e-4d9a-bca2-591999598532 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.908931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.936390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.937004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.937418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.937688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.937961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.938327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.938623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.938989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.939464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.939938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.940157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.941195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.943870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.951314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 454/899] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:37.952175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.972010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 446/900] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:37 2022] POST /identity/v3/services => generated 241 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:37.972435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.120487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a11c8-0e91-46a2-9485-bc84ba0bcc2f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.131053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be20f-8033-48b2-a36e-b5111c2594fa None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.155263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.169600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.170519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.173582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.174138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.175121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] RBAC: Adding query filter params (interface=public, service_id=9979f4468e6c4748868dc73fb3dfe099, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:38.175591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.177405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.189576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 447/901] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/endpoints?service_id=9979f4468e6c4748868dc73fb3dfe099&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.191366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.195496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.197412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.197412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.197780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.214778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.216581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:38.236239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:38.237321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:38.239146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:38.239146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:38.239146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:38.239146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 455/902] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:38.244936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.286501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.385791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f762be-9a23-451f-989c-08a1751fae18 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.398206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2317f-773b-4a79-80d3-b4fe2adb01ed None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.439111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.439629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.440736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.441557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.443333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:38.444010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.446903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.461136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.463723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.464335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.464820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.465758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.468263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9cf79-2521-40ec-8257-641d4e76fff9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.474185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 456/903] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.482847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.483219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 448/904] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/services => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:03:38.658010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.676667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6131c8-84cc-428b-9b01-af07138d6000 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.697281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e8e7-a6f7-4c65-b8b5-4b9dc09a8554 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.698142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e8e7-a6f7-4c65-b8b5-4b9dc09a8554 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.698307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e8e7-a6f7-4c65-b8b5-4b9dc09a8554 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.701582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 449/905] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:38.706277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.706603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.706809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.728177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:38.729598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:38.738901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.739886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.740333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.740748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.753031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.754484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:38.770188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:38.771437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:38.773382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 457/906] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:38.781114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.819532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.840006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 450/907] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:38.930947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ac4f-7226-437d-952c-7e5bb1a5de14 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.979304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.979881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.980194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.980461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.981228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:38.981955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.983972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.005449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 458/908] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:39.013332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.166973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52a09-b8db-4e80-98af-3c91383dd90f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.195281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.208302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.208926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.209208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.209477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.216177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.293345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.322659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.324239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.368785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc131-9649-45b7-ba95-6f4a15469485 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.417514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.418843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.419802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.420612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.421426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.423012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:39.435290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:39.436401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:03:39.437260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:39.446450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 459/909] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:39.448860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.496584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 451/910] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:03:39.501723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.562965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.625225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.628750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c792-07c2-41b4-b814-5e11b2bd7df2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.647042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4b2a-1c40-4587-befa-f991f0da6025 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.695951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.696382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.697172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.697547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.697916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.698413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.699125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.699799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.702005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:39.702769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.705652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.711452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.713732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.718614 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 460/911] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:39.724667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:39.738601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:39.740053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:39.741343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:39.741343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:39.741343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:39.752173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 452/912] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:39.756055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.849306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a21bd-8962-491f-a5d0-dde3e66ee07d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.894975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.895702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.896069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.897060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.897829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:39.898205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.900733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.904367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.913646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad6ebd-675c-465e-a0ef-f5fd5e63c162 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.915699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 461/913] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:39.918525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.978635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.979293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.979576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.979844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.980547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:39.980850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.982310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.992935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:40.005502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 453/914] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:40.012145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:40.090291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0441-6a14-4163-8203-f6e1de613e1a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:40.138957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:40.139642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.140052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.140418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.141203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:40.142724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:40.183471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 462/915] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:40.208297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa972d8-d23f-4432-8825-7793d0964d06 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:40.278844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:40.279994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.280496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.280973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.290056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:40.292007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1884d115-c1a1-43bd-84f4-8cf098299ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:40.307476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:40.308447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:40.309330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:40.316088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 454/916] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:40.318420 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:40.391810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:40.404324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79eaa-7b6f-438c-9287-65315e67a287 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.404643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79eaa-7b6f-438c-9287-65315e67a287 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.404863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79eaa-7b6f-438c-9287-65315e67a287 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.406518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 455/917] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:40.412872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.413174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.413433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.434244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:40.435425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:40.454153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fdb5-14ad-4359-91c1-bb9ce8113a2b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:40.497651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:40.498517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.498909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.499136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.500020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:40.500516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:40.501975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:40.507870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:40.520908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 463/918] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:40.528327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:40.532279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 456/919] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:40.643481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058b51-1a83-4a45-ad64-d5e1dddcad32 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:40.672453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:40.680027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:40.680641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.680992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.682051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.682779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] RBAC: Adding query filter params (role.id=b24716bf96554627a4545da2a1fcbd74, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=550e5809b04c434daf6144e4b6cc3517) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:40.683087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:40.684601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb8ac7-0327-480f-bcf0-dc48b13a1929 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:40.690623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 464/920] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:40 2022] GET /identity/v3/role_assignments?user.id=550e5809b04c434daf6144e4b6cc3517&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b24716bf96554627a4545da2a1fcbd74 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:40.816563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:40.930474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b07c-fa58-4100-a804-abc2a51d40eb None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.931905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b07c-fa58-4100-a804-abc2a51d40eb None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.932418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b07c-fa58-4100-a804-abc2a51d40eb None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.934240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 465/921] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:40.940159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:40.940772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:40.941258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:40.961835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:40.963474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:40.991944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7171c7-c155-4fb6-992b-5fc4ca812ff9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.056699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 466/922] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:41.065583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.066643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.067139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.067601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.068726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.071497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:41.092800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:41.093989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:41.094945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:41.095801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 457/923] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:41.106023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.255268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f0877-3de5-41d6-8b56-4ef6f971b722 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.275488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:41.308966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.309920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.310350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.310768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.311551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:41.312106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.313639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.319534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 467/924] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:41.325972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.386843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:41.410535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.446716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a524e-53f8-4c30-b6c5-f8286246a543 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.486221 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.486744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.487027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.487298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.488035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:41.488347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.489744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.501418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 458/925] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:41.502794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.532779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06f97-1f3f-4f06-8218-7b22067de4b6 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.573131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.574243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.574811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.575279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.576114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.577887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:41.588778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:41.589884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:03:41.590762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:41.598555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 468/926] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:41.599901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.625456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bf3-955a-4152-b7f8-142a28bfa544 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.641498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:41.652097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:41.667935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.668938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.669439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.669980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.670921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] RBAC: Adding query filter params (interface=public, service_id=8176ea3aac1047ddba939ef17fb3f8ee, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:41.671433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.673119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.684283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 459/927] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/endpoints?service_id=8176ea3aac1047ddba939ef17fb3f8ee&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:41.685636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.722941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ebcb-5188-41a4-9d77-853534632669 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.762906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.763689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.763983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.764274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.764924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:41.765204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.767445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.777106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 469/928] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:41.779833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:41.832128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d581f-6587-488b-8a23-f8a76284b6cf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.886405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:41.887793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.887793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.887793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.888616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:41.890561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:41.908278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 460/929] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:03:41.945661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d4d7-51be-42a2-bff7-db70918bf7e2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:41.948781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.016707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.017760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.018247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.018694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.019837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:42.020345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.023024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be06f2e-b630-4c56-af0a-7be0118cf06b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.033760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 470/930] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:42.039832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.095545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.172117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32dbf-68f7-4944-a991-206b5b9fd5c3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.214286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.214910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.215183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.215460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.216188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.217627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a60cb-4001-442b-9cfa-7dae6742703b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.244876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 461/931] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:42.641874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbef2d3-395f-4eb4-a0cb-22fbbf7e1377 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.642728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbef2d3-395f-4eb4-a0cb-22fbbf7e1377 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.642728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbef2d3-395f-4eb4-a0cb-22fbbf7e1377 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.644178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 471/932] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:42.650213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8772-21fd-4063-8410-5dc3d3177c50 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.650608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8772-21fd-4063-8410-5dc3d3177c50 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.650802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8772-21fd-4063-8410-5dc3d3177c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.671208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-dcfe8772-21fd-4063-8410-5dc3d3177c50 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:42.672451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-dcfe8772-21fd-4063-8410-5dc3d3177c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:42.762144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 462/933] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:43.214299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbef2d3-395f-4eb4-a0cb-22fbbf7e1377 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.240493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451304-b2f8-4e1f-b7b7-da5c6e199f7a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.241434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451304-b2f8-4e1f-b7b7-da5c6e199f7a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.241928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451304-b2f8-4e1f-b7b7-da5c6e199f7a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.244392 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 463/934] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:43.253771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.254410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.254898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.275381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:43.277007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:43.296645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.393646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 464/935] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:43.395066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbef2d3-395f-4eb4-a0cb-22fbbf7e1377 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.465282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.466141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.466688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.467100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.467808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.469946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.474517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING keystone.server.flask.common [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 12:03:43.511004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.sql.core [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:03:43.511004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:03:43.511004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [parameters: {'id': '9f9ee7d032e445eb894e622ff900ee03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:03:43.511004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81576) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f9ee7d032e445eb894e622ff900ee03.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f9ee7d032e445eb894e622ff900ee03. Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:03:43.535157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application result.read() Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 12:03:43.536122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application yield resource Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise self.value Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application session.commit() Sep 13 12:03:43.537618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:03:43.538499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:03:43.539474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application result.read() Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:03:43.541232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [parameters: {'id': '9f9ee7d032e445eb894e622ff900ee03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.543339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:43.545293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f9ee7d032e445eb894e622ff900ee03. Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.548454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 472/936] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Sep 13 12:03:43 2022] POST /identity/v3/projects => generated 262 bytes in 324 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:43.556373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.670111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5208-eb76-46f9-b65e-6512bcc9993e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.686713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.716789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.717000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.717217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.717391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.719291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.726103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.728763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:43.747745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:43.748729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:43.754668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 465/937] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:43.756924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.773352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.817307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd216d7-5f6c-430d-8e48-30ccec52a0f9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.862853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.863489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.863763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.864055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.871171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c79151-41a6-4ecd-84de-ac7ee6a4b392 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.877650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:43.884575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:43.885582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:43.891653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 473/938] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:43.894155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.912502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.913533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.914666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.915190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.916169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:43.916668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.918448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.943585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 466/939] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:43.995724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.018548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af580be-67ba-442a-8b34-1e4b5a84491a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.059893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.060539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.060810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.061073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.061752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:44.062046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.063727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.076986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 474/940] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:44.085423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.170270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.207665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46830-31bc-415f-bf78-f040b14053d0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.245582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.246259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.246506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.246737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.257653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.259097 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:44.275450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:44.276501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:44.277612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:44.277612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:44.277612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:44.277612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 467/941] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:44.284811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.395377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9962-8249-41c8-be92-cbfcdf7f5237 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.432979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.433599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.433871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.434134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.434779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:44.435073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.436529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.449877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 475/942] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:44.455723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.572575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b817dff-c081-4613-9ed8-6e091fdb1106 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.602414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.616440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.617494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.617976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.618447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.627557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.629454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:44.642954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:44.643989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:44.644955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:44.652082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 468/943] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:44.654851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.658948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.777480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ff7f-9573-4080-9750-7ddf95aa4ddd None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.816838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.817463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.817734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.818000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.818746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:44.819043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.821176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.843015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 476/944] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:44.849656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.968936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b7b9-30d7-4cff-849c-e3e1de802336 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.004879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.005508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.005779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.006044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.017655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.019158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:45.034564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:45.035559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:45.036853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:45.036853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:45.036853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:45.036853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 469/945] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:45.045103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:45.117110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:45.159483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96bb1c-7170-4dda-8e72-0d4cb0e5e325 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.218529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.219939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.220689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.221397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.222820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:45.223585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.226899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc69ca-4c20-4efc-ab02-d63c477348ff None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.249375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 477/946] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:45.260002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:45.301704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:45.386341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd07a-352f-41fa-a950-7f02a7bbe3c6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.443521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.444573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.445070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.445526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.454775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.456266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:45.469405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:45.470449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:45.471344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:45.472598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e0b-a629-4eba-8dba-b35b3701b0d8 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.472737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 470/947] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:45.472819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e0b-a629-4eba-8dba-b35b3701b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.472819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e0b-a629-4eba-8dba-b35b3701b0d8 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.476445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 478/948] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:45.478157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:45.483496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85101-44d6-45da-93c4-18fa564a03a0 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.483784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85101-44d6-45da-93c4-18fa564a03a0 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.484105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85101-44d6-45da-93c4-18fa564a03a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.515326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-33f85101-44d6-45da-93c4-18fa564a03a0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:45.518562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-33f85101-44d6-45da-93c4-18fa564a03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:45.619384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:45.628204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 479/949] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:45.635628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff340-5df9-4259-8d1a-b94a37de2e56 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.670144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df016-1d9d-4223-9cde-bbec27475403 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.672776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df016-1d9d-4223-9cde-bbec27475403 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.673027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3df016-1d9d-4223-9cde-bbec27475403 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.674600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 480/950] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:45.681223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.681529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.681788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.683874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.684745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.685216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.685693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.686585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:45.687081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.688772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.702052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:45.703355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 471/951] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:45.706632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:45.709679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:45.784263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:45.802654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 481/952] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:45.830083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13595be-2c04-4d0b-b4f6-6450dd576823 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.867583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.868275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.868542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.868810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/550e5809b04c434daf6144e4b6cc3517/roles/b24716bf96554627a4545da2a1fcbd74` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.871037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=550e5809b04c434daf6144e4b6cc3517, role_id=b24716bf96554627a4545da2a1fcbd74)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.872574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.896178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 472/953] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:45 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/550e5809b04c434daf6144e4b6cc3517/roles/b24716bf96554627a4545da2a1fcbd74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:03:45.942706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.087868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668eae3-2a97-4552-bbc0-a1946e0f26bc None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.127347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.128394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.128874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.129341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.130138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.131697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:46.142852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:46.144303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.145210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 482/954] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:46.150558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.173887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.196303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.246542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.273071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df03a57-0144-4a87-96de-521980e5f6b7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.307587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5405-afe1-48b2-bc99-2df13931e57e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.323310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.324499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.324957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.325382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.326417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:46.326913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.328596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.335827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 473/955] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:46.342329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.351223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.351994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.352350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.352683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.353382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.354984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:46.369061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:46.370162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:46.371041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:46.373836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 483/956] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:46.381532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.458733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.484008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba67e-6ae6-45ea-8194-668649c3929b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.497254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0392-62ff-47f4-b424-bd88ba6a54f7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.510688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.520518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.521137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.521415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.521694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.522334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:46.522687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.524079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbecf-25d5-4f53-ae5d-6dd8bc1634ce None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.529350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 474/957] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:46.530376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365b5a-e3a5-4f26-b4cb-4dbbf83626e5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.530666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365b5a-e3a5-4f26-b4cb-4dbbf83626e5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.530935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365b5a-e3a5-4f26-b4cb-4dbbf83626e5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.536435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 475/958] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:46.537175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365b5a-e3a5-4f26-b4cb-4dbbf83626e5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.542492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.543111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.543389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.543668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.544494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] RBAC: Adding query filter params (name=compute) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:46.544819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.546657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b49463-4159-4250-bf57-9434562b8fce None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.558431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 484/959] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:46.558431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.558431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.558431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.577338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:46.578551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:46.658020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365b5a-e3a5-4f26-b4cb-4dbbf83626e5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.667994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 485/960] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:46.667994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:46.707008 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.707632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.707913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.708225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.708989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.710455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.730969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.742118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 476/961] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:46.886795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a83f4c-6f02-4976-a227-59224de2866f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:46.892403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:46.955391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:46.956050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.956337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.956604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.957262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:46.957564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:46.958978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:46.964982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 486/962] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:47.171366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.312694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3352899-d75b-4105-a9ab-5ee7c562475c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:47.350925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:47.351550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.351831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.352135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.352788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:47.354222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:47.356873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING keystone.server.flask.common [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 12:03:47.370138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.sql.core [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:03:47.370138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:03:47.370138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [parameters: {'user_id': '3195cf964e4f49ea9c995aa65441166b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:03:47.370138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81577) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Sep 13 12:03:47.377807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:03:47.378676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application yield resource Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise self.value Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application session.commit() Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:03:47.379613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:03:47.380543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:03:47.381411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:03:47.382829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [parameters: {'user_id': '3195cf964e4f49ea9c995aa65441166b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:47.383656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 12:03:47.390246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:47.392421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 477/963] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 12:03:47 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:47.395771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.566558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92026-aadd-430b-a0fb-b372721d40a7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:47.629373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:47.630433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.630985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.632079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.645884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:47.649189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-24f737a4-ba44-4f14-8253-db4af822cac8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:47.672125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:47.673175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:03:47.674137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:47.674669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 487/964] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:47.681468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.746623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:47.792954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede248bf-66ae-45a7-b1cc-ebbe0a686abe None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:47.832704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:47.833683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.834165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.834681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.835606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:47.836140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:47.838027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c84efd-2325-46b4-b06a-f1366d4a0024 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:47.879855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 478/965] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.394856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196d5a-f1fb-44c0-9742-3d2dc8fa5cef None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.395407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196d5a-f1fb-44c0-9742-3d2dc8fa5cef None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.395407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196d5a-f1fb-44c0-9742-3d2dc8fa5cef None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.397649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 488/966] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:48.403506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.404000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.404079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.423366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:48.424851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:48.508576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 479/967] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:48.782168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196d5a-f1fb-44c0-9742-3d2dc8fa5cef None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.809649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.904471 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196d5a-f1fb-44c0-9742-3d2dc8fa5cef None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.943570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.944418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.944705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.944974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.957874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-89d03d56-e48f-4c22-a433-577627c50ce8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:48.962983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:48.963972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:03:48.964869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:48.968072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 489/968] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:48.970596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.035640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.094544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f213c8-4b61-4ceb-b701-c72b1b90d89c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.118874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444e9c8-eee4-47f8-a807-5f11e2795568 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.119182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444e9c8-eee4-47f8-a807-5f11e2795568 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.119492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444e9c8-eee4-47f8-a807-5f11e2795568 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.121035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 490/969] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:49.126190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8d4e-371d-4081-85e6-f227638fc641 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.126470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8d4e-371d-4081-85e6-f227638fc641 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.126742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8d4e-371d-4081-85e6-f227638fc641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.141872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.142491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.142783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.143033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.143688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:49.144024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.145322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-5b1b8d4e-371d-4081-85e6-f227638fc641 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:49.145491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.146647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5b1b8d4e-371d-4081-85e6-f227638fc641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:49.159496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 480/970] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.161499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.255220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 491/971] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:49.293656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e483-4636-4d42-aea4-43f4b256581b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.311534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.336257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.336894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.337173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.337341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97638f5-4062-42c9-a934-e7b4fc89423d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.337472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.337591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97638f5-4062-42c9-a934-e7b4fc89423d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.337715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97638f5-4062-42c9-a934-e7b4fc89423d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.339468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 492/972] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:49.344512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.344788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.345051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.350485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.352016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.364725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:49.365962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:49.367476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:49.368489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:49.370055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:49.370055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:49.370055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:49.370055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 481/973] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:49.374982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.378342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.440441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 493/974] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:49.493329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da1d9-8438-46b6-8bd8-50179fc92f3f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.526081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.533751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.536312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.539530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.539807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.540528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:49.540833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.542216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.555670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 482/975] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:49.561353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.588036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.655176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ece9a-0afd-483f-ba26-0cddc55ec8ff None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.681460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395067d-835a-43f3-906f-8ab39ed13501 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.697722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.698360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.698883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.699169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.700172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.701703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:49.713480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:49.714727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:49.715726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 494/976] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:49.716669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.721224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.721858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.722137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.722408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.727926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.730597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.732071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:03:49.744338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:49.745431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 483/977] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:49.746353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.821726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869613-3d0e-4a84-a2a6-a79d00f4a2f8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.832946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.850030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e48260-a450-40cf-ae8d-5ed0043ecb54 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.856972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.857578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.857848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.858110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.858754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.860183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.876073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 495/978] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:49 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:49.877239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.902548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.903233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.903519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.903793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.905178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:49.905575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.907023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.913452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 484/979] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.919631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.960919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.003179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3510-1bda-47a7-a466-f42321e6f38f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.047116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.047344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f2ba-7945-4dd8-b3ca-e0a543bd3712 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.047739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.048042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.048311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.049283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.049597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.052022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.076234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 496/980] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:50.081751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.093180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.094098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.094833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.095531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.096359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.096979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.098973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.104463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 485/981] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:50.110555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.124658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.227361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37fca-f932-49d8-ae8e-2f5e2b83a14d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.233861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063e97-6269-4ad0-8dbf-f00dd096114f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.269363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.280124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.280735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.281009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.281273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.281854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.281968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] RBAC: Adding query filter params (interface=admin, service_id=8176ea3aac1047ddba939ef17fb3f8ee, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.282266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.282465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.282744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.283015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.283721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.295366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 486/982] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/endpoints?service_id=8176ea3aac1047ddba939ef17fb3f8ee&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:50.296833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.395147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.398622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.402044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.455604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988a5-3540-4d8e-aa6d-be25f434d04a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.501162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.501852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.502179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.502357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.503001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.504566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.511303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 487/983] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/services => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:03:50.567916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 497/984] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:03:50.574304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.713581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385207c9-998a-4171-8315-4ae352cb5fd8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.776253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.776908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.777180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.777446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.781099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.793667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.796412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:50.822411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:50.823824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:50.824874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:50.824874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:50.824874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:50.824874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 488/985] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:50.830408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.868722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.948962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b924916-f699-496a-84f5-880fc3d20c31 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.989962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.990478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.990751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.991015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.991657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.991951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.993309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.006520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 498/986] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:51.012289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:51.150455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1dce-f2f5-455a-8527-2a6b125b0efd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:51.196498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:51.197170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:51.197596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:51.197726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.205459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.206917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:03:51.219329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:51.220308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:51.221351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 489/987] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:51.228085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:51.327028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:51.345539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf21c0-3d47-419e-a79e-d0963b9e865e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:51.382876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:51.383495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:51.383777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:51.384052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.384761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:51.385059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.386505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6db9-ffda-4e49-aae4-68e5c5e3b1b8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.405224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 499/988] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:51.406502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:51.464322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:51.522240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007374a4-939c-4d1a-b30a-fd6e50f10b79 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:51.573543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:51.574364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:51.574640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:51.574938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.575751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] RBAC: Adding query filter params (role.id=b24716bf96554627a4545da2a1fcbd74, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=550e5809b04c434daf6144e4b6cc3517) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:51.576095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.578043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7bc74-0221-40ab-8115-72d77a310fbb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.592017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 490/989] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:51 2022] GET /identity/v3/role_assignments?user.id=550e5809b04c434daf6144e4b6cc3517&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b24716bf96554627a4545da2a1fcbd74 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:52.192507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854749f-91f7-4f35-865a-edba57048e2b None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.193119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854749f-91f7-4f35-865a-edba57048e2b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.193119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854749f-91f7-4f35-865a-edba57048e2b None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.194551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 500/990] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:52.200558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.200971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.201355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.223364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:52.225222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:52.306264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 491/991] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:52.585786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854749f-91f7-4f35-865a-edba57048e2b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:52.700242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854749f-91f7-4f35-865a-edba57048e2b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:52.738417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:52.739103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.739377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.739649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.740282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:52.741663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:52.751505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:52.753784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:52.756752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:52.765188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 501/992] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:52.765446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:52.846549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:52.928225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4cfff-b248-4ab8-8851-08548aad9b18 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:52.967824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:52.968469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.968754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.969017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.969736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:52.970040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:52.971413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416470-6c56-4950-8143-9d2a13c9b4dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:52.982287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 492/993] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:52.984018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.001856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.055514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5782c9-b198-480f-896a-2fc70f97e0af None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.055775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5782c9-b198-480f-896a-2fc70f97e0af None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.056087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5782c9-b198-480f-896a-2fc70f97e0af None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.057485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 493/994] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:53.063384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.063670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.063932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.084489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:53.085504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:53.123689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49266-61d8-4df0-bcf1-02761ecedcc9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.165162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 494/995] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:53.188659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.189772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.190267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.190772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.191704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] RBAC: Adding query filter params (type=compute) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:53.192790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.194850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.201199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 502/996] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.207110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.269557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.397339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a978-22b4-4874-a21d-2bf22307c991 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.436274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.448494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.449114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.449397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.449673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.450393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] RBAC: Adding query filter params (interface=public, service_id=471c05b90bce4e28bb91075a093fabd5, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:53.450702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.452132 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.458320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 495/997] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/endpoints?service_id=471c05b90bce4e28bb91075a093fabd5&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.466295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.542691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.577818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df1eb-7302-4dff-b499-14efa27b8aca None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.583236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfa9f-4f8d-48cd-a324-10ff3e5398e1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.585316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.630477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.631105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.631381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.631654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.632299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.633681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.640874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 496/998] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:03:53.643919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.644688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.644967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.645242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.645907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.647861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:53.658255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:53.664542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:53.666243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 503/999] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:53.669608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.827477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2a6c-29be-4cf1-a591-21661a910cea None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.886929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.887856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.888333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.888767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.889760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:53.890237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.892572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9ac15-757f-4eea-8fad-42c3dc75821d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.901407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 497/1000] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.909221 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.932732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2049-c841-42bb-b4f3-2faf45bfb9fc None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.933084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2049-c841-42bb-b4f3-2faf45bfb9fc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.933786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2049-c841-42bb-b4f3-2faf45bfb9fc None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.935354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 498/1001] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:53.942032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.942317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.942636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.963444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:53.964682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:53.995109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.035225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b802c-a451-4e8b-bd2b-ec2e0e22d203 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.044596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 499/1002] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:54.074252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.074862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.075139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.075406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.076069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:54.076373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.077724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.083500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 504/1003] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:54.089225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.208629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128c31-3d6e-413c-9f66-804995b51a3d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.246719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.247567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.247936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.248328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.249098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.250573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.270713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 500/1004] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:54.327694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.331574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.459404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560156a-c102-43b2-9f30-f53fd13751ad None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.516087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.516732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.517017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.517287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] PATH_INFO: `/v3/services/image` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.517873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.519235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:54.529125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:54.530466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:03:54.531638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:03:54.533539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 505/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:54.539399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.568435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.682121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970331-e41d-4eba-90c8-ca4a99de2ff0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.723829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.724365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.724795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.724981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.725535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:54.725843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.727210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caa7c5-dd71-4119-9b33-3c5f56c663a4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.737371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 501/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:54.740807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.808021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.856079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f5f0-ad1e-4bb3-bd9f-2e8792e1ee47 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.895345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.896079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.896424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.896760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.897458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] RBAC: Adding query filter params (type=image) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:54.897828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.899262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620af1-9ac7-4481-a624-4cf031dcf511 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.905749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 506/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:55.930499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7751-2b22-4fb7-b1ed-6b575a07208e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.931911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7751-2b22-4fb7-b1ed-6b575a07208e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.931911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7751-2b22-4fb7-b1ed-6b575a07208e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.933367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 502/1008] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:55.942943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98b26-77b2-444a-b226-6070c5806bef None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.943574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98b26-77b2-444a-b226-6070c5806bef None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.943701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98b26-77b2-444a-b226-6070c5806bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.963081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-cbd98b26-77b2-444a-b226-6070c5806bef None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:55.964296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-cbd98b26-77b2-444a-b226-6070c5806bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:56.058357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 507/1009] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:56.356804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c7751-2b22-4fb7-b1ed-6b575a07208e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.465217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:56.492105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c7751-2b22-4fb7-b1ed-6b575a07208e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:56.532240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:56.532940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.533205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.533543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.534173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:56.536090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:56.539639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871a84-b40b-422d-9b15-efcb522631c8 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.539918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871a84-b40b-422d-9b15-efcb522631c8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.540223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871a84-b40b-422d-9b15-efcb522631c8 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.541605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 508/1010] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:56.547321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.547691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.548049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:56.549275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:56.550679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:03:56.552231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 503/1011] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:56.556770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.578760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:56.579951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:56.643028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:56.663303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 509/1012] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:56.678695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526469c0-2263-4a02-9ac1-8603cb2b125d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:56.722747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:56.723504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.723887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.724283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.725031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:56.725431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:56.726918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:56.738751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 504/1013] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:56.740761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.857168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4cbf0-6c78-4e53-a1f2-6ff9c9268f9b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:56.895063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:56.895834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.896302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.896737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.897543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:56.898001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:56.899586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:56.905905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 510/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 12:03:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:56.911403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.924507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:56.929653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.993346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.050212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f394fd-8d5a-41b1-b871-6d7c602256a9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.054126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d2282-2022-4b58-8b9f-f0d32c5791e7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.094377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.094991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.095298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.095541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.096262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.098200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83173e61-7e6b-42a6-8e3e-54dcdbff6310 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.098719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.099352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.099622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.099885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.101103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.102490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.108013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 511/1015] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:57.109821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.123364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 505/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:03:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:03:57.180612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dd51-ba2f-49e4-a9b5-85b523350fb2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.180928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dd51-ba2f-49e4-a9b5-85b523350fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.181177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dd51-ba2f-49e4-a9b5-85b523350fb2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.182828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 506/1017] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:57.188557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.188845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.189118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.214676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:57.216723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:57.243828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e3ef8-17bf-4090-8068-e6237a7f42c1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.267605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.303020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.303414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.303689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.303989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.304674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.305464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.306138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edba4-d134-4caa-9661-8f0c0fa6e32e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.320015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 507/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:57 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:57.342878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 512/1019] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:57 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:03:57.588053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.707038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfb600-122d-4631-a2ed-213e3ee19922 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.750037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.750669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.750940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.751248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.751893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.753951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79766b4f-8db2-418d-a7ed-26cb80fd23e2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.770197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 508/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:57 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:59.522033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6a7b-2588-4c0f-b4d3-20f4000855e4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.522571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6a7b-2588-4c0f-b4d3-20f4000855e4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.522571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6a7b-2588-4c0f-b4d3-20f4000855e4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.523979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 513/1021] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:59.529997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.532378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.532378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.552819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:59.554018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:59.611781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:59.629460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15884d-a66d-4600-8f6a-c39d4fa720fb None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.629743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15884d-a66d-4600-8f6a-c39d4fa720fb None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.630012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15884d-a66d-4600-8f6a-c39d4fa720fb None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.631348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 514/1022] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:59.636897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f240-4ded-4cd1-9d81-5b9474767da6 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.637173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f240-4ded-4cd1-9d81-5b9474767da6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.637446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f240-4ded-4cd1-9d81-5b9474767da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.660517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e2a8f240-4ded-4cd1-9d81-5b9474767da6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:59.661731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e2a8f240-4ded-4cd1-9d81-5b9474767da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:59.664209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 509/1023] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:03:59.739250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 515/1024] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:03:59.935333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:59.989775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4646-ff15-49f8-8bd7-290a850916b4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.990092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4646-ff15-49f8-8bd7-290a850916b4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.990323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4646-ff15-49f8-8bd7-290a850916b4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.991860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 516/1025] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:59.997473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.997751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.998022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.022710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:00.023915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:00.050999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13892d63-b858-4c1f-abf5-808a9a13bf36 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.085653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.086286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.086560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.086831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.093445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 517/1026] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:00.094306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.101126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:00.105936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:00.106884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:00.107857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 510/1027] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:03:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:00.113186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.133176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.170430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.236881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c03e-ff36-4d15-8564-65c6e5ab7dd7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.241452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed93fa-069f-40fd-a2e6-97e33207403d None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.279040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.279281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.279656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.279898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.280114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.280200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.280305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.280462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.280931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:00.281177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.281515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.282548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.282905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.284743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 518/1028] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:00.290296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.292673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 511/1029] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:00.298297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.412247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.419022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9029666-c3b0-4456-b5eb-2ca551efb5b4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.420545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14369c0c-d0d2-4db4-9b02-cea8acea94d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.423019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.457718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.458074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.458344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.458617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.458737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.460196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.460305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.460305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.460305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.461264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.470872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.473581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.496081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 519/1030] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:00 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:04:00.496081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:00.496364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:00.497225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:00.498122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:00.498122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:00.498122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:00.498122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 512/1031] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:00.502480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.631172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39c684-1a95-4ebe-898b-fb101eca44f5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.638763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbee9-ff01-4d1b-88fd-389eae24aa13 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.685023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.686623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.686623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.686623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] PATH_INFO: `/v3/services/image` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.686623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.687698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.688584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.689206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.689482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.689747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.690980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:00.691278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.692706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:00.699409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:00.700819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:00.701771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 520/1032] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:00.707955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 513/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:00.708324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.713973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.729893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.737613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:00.847015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae83e8-b59d-48b6-b922-fcce4571f295 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.858712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b713ed-f800-40c6-ad1f-70f10b9b972e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:00.899138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.900039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.900438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:00.900629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.901044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.901162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.901340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.901607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.902228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:00.902687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.904398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.909734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:00.912014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:00.915442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 521/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:00.916921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:00.929537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:00.931910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:00.934281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 514/1035] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:00.937340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.023072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.047698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60ccc5-e20a-46ed-8cd5-2de23e9045f5 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.058827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.089728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39f3b-e9be-4eae-836e-f2fa68b773ed None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.091286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.091911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.092236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.092507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.093144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.093442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.094788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.105573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 522/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:01.106581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.129840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.130450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.130725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.130999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.131727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.132057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.133490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.154500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 515/1037] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:01.160452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.251106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997770-bd6b-4459-83f8-395fabb2b1c7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.281050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7b99c-6da1-4ff1-ad80-222029e5fea9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.289944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.290557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.290832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.291224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.291886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] RBAC: Adding query filter params (interface=public, service_id=fd09b10f1a7f46aeb73f8115cfef6cf2, region_id=RegionOne) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.292144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.293576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.306717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 523/1038] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/endpoints?service_id=fd09b10f1a7f46aeb73f8115cfef6cf2&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:01.309659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.322630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.323232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.323850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.324155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.324426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.328092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.409461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.410850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.437289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc063efe-092c-47f8-a817-a62b7aa92ef3 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.474862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.475622 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.475895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.476228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.476841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.478208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.488076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 524/1039] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:04:01.540367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 516/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:01.542205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.659430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.701590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366dd5a-8836-410d-a6ab-fca64aebbb5e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.750586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.751559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.752009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.752417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.769693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.772134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:01.796272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:01.797325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:01.798254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:01.798254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:01.798254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:01.798964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 525/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:01.805647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.849440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.932205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507e58b-bb5d-4408-940b-2699105e59ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.969233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.969764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.970041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.970313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.971494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.971799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.973220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.990891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 517/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:01.992223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:02.116095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b930-3f96-44a1-8e03-ca395219fa83 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:02.140146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:02.156018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:02.156018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.156018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.156018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.169660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:02.171118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:02.183591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:02.184602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:02.189205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 526/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:02.191231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:02.301228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:02.309842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a9a-c7cf-44d5-b60f-88e700f8d3d8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:02.346816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:02.347419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.347691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.347952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.348727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:02.349024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:02.350440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becca7e-bc33-494b-bf6b-69f286447ecb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:02.368056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 518/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:02.369900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:02.509236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5597b1-c63d-4750-9f5b-353f7b2d64d4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:02.551459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:02.554832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.554832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.554832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.554832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] RBAC: Adding query filter params (role.id=b24716bf96554627a4545da2a1fcbd74, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:02.554832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:02.557076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a590-f3b8-4c36-a067-821b67e2ba07 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:02.575984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 527/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:02 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b24716bf96554627a4545da2a1fcbd74 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:02.815382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6abf-537e-4690-8e8d-8061cb28222d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.815935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6abf-537e-4690-8e8d-8061cb28222d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.815935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6abf-537e-4690-8e8d-8061cb28222d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.817591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 519/1046] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:02.823376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.824223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.824223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.843782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:02.843782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:02.901979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:02.940866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 528/1047] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:03.222876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6abf-537e-4690-8e8d-8061cb28222d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:03.367848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6abf-537e-4690-8e8d-8061cb28222d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:03.404715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:03.405355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.405633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.405899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:03.417734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:03.422536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:03.424390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:03.425683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:03.429305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 520/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:03.430691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:03.548215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f441b7-454e-4016-92b2-f50872c24738 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:03.585260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:03.585874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.586151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.586418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:03.587084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:03.587382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:03.588803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383a43-37bd-4598-bec1-aa29af5ed3c4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:03.600920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 529/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:03.607269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:03.627138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:03.725111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ee6c-fa5c-4b53-8092-39bb51fb5a71 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.725289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ee6c-fa5c-4b53-8092-39bb51fb5a71 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.725563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ee6c-fa5c-4b53-8092-39bb51fb5a71 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:03.726934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 530/1050] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:03.733272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.733272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.733272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:03.736269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61460e9-eed8-4724-8c14-66c784eed6af None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:03.752056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:03.753264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:03.774670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:03.775303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.775588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.775843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] PATH_INFO: `/v3/users/342b203c464043da8e2aa283bc88542c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:03.790510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:03.790698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=342b203c464043da8e2aa283bc88542c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:03.792072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:03.799223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 521/1051] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:03 2022] GET /identity/v3/users/342b203c464043da8e2aa283bc88542c => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:03.800490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:03.844367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 531/1052] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:03.896054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:03.933952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04109-9fac-49c1-b2db-b18175adb6a3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:03.971523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:03.972162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:03.972444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:03.972723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.047788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.049245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.117122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.131633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:04.188328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 522/1053] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:04.190363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.243398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b0f4-61de-4de8-a4fb-53a539bda293 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.294618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.295304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.295590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.296029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] PATH_INFO: `/v3/services/image` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.296920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.300082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:04.317535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:04.319394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:04.321002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 532/1054] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 12:04:04 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:04.327548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.335720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e3db-2c3e-40bd-960c-3684afcf7580 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.379033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:04.383159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.383807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.384115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.384384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.385598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.387055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.388997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 523/1055] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:04 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:04.395768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.447948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:04.467218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514f41-9dd4-4f59-9760-af927aecba3d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.509948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.510562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.510847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.511120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.511755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] RBAC: Adding query filter params (name=image) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:04.512083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.513457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.514336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293755d4-e711-42a1-ac5c-fc2a51948ac3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.520472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 533/1056] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:04.525973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.555263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.556242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.556782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.557048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.557946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=4c714d1eaffd4f96addb79ab05e89942, user.id=342b203c464043da8e2aa283bc88542c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:04.558590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.560134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.569981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 524/1057] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:04 2022] GET /identity/v3/role_assignments?user.id=342b203c464043da8e2aa283bc88542c&scope.project.id=4c714d1eaffd4f96addb79ab05e89942&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:04.658151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:04.670003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e311ff-745a-4ae0-8e24-1c97bfd9425d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.724914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.725550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.725825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.726311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.726770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] RBAC: Adding query filter params (type=image) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:04.727185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.728549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb265c34-b9f7-41a2-bfae-c7880a0eaf66 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.734683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 534/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:04.740650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:04.783511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d70d-9fc2-4713-8c49-c3cf3f68a157 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.783796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d70d-9fc2-4713-8c49-c3cf3f68a157 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.784100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d70d-9fc2-4713-8c49-c3cf3f68a157 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.785558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 535/1059] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:04.790554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.790832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.791104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.812386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:04.813506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:04.877765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709d50-9d4a-4cc0-9ca5-c5ea20b9da40 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:04.880177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:04.890365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 536/1060] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:04.921553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:04.922213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.922439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.922706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.923415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:04.925092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:04.951483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 525/1061] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:04:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:05.161986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.276663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:05.288086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b29c4-9ca4-4c03-9886-07ec6238be84 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.331770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.332445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.332725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.332997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.344108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:05.349916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:05.350911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:05.351801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 537/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:05.358062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.474258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07510f1d-1da1-4287-9a9e-bc05e2b580b9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.516294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.517041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.517323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.517636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.518624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:05.518938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:05.520955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:05.535310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 526/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:05.536403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.645390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dbee2-c109-49a9-886e-3e1c8b628c95 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.682180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.682825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.683101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.683361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.695475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:05.697066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:05.705629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:05.715603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:05.716852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:05.717759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:05.717759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:05.717759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:05.717759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 538/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:05.724142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.754965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:05.852710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b01ef-1a64-4751-ae91-31501c15f4a2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.895432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.896143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.896424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.896699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.897362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:05.897662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:05.899047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:05.920550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 527/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:05.922218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.069372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5292e-6d73-4daf-86bd-ca6c262387af None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.107299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.107925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.108243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.108604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.118031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.119715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:06.132561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:06.133577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:06.141139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 539/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:06.141863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.248241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.271187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1cfa-754c-418e-900f-6866e36b0063 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.313198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.313846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.314121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.314388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.315134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:06.315435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.317292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.339463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 528/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:06.346065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.414707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.459267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7cb4e-9d8d-4499-a0af-9fc025b32781 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.494575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.495205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.495481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.495747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.506769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.508234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:06.523302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:06.524458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:06.525352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:06.525352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:06.525352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:06.525352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 540/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:06.530166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.642590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ceae0-2e56-42dd-a0e3-f4304ade99cc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.683388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.684469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.684950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.685421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.686593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:06.687127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.689544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51f7b-3d83-4504-a93e-1f9c5ca5d11b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.701403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.711862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 529/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:06.712605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.801601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe0c6-61e7-44aa-b563-5d1f8a4fc945 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.801880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe0c6-61e7-44aa-b563-5d1f8a4fc945 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.802154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe0c6-61e7-44aa-b563-5d1f8a4fc945 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.803692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 530/1070] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:06.808948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba083-5675-4d58-9daf-699787425859 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.809365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba083-5675-4d58-9daf-699787425859 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.809679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba083-5675-4d58-9daf-699787425859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.828599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b86210-4279-44f5-a55c-8e4a2402483e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.837734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-63eba083-5675-4d58-9daf-699787425859 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:06.839902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-63eba083-5675-4d58-9daf-699787425859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:06.846454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.882895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.884262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.884529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.884801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.893014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.894376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:06.906303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:06.907282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:06.908773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:06.912981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 541/1071] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:06.913271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.927760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 531/1072] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:07.023485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34f33-0330-46b2-a93f-bb5d7f55079c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.059383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.060024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.060304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.060572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.061291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:07.061593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.063005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.082013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 542/1073] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:07.083044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba083-5675-4d58-9daf-699787425859 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.198244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.199130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba083-5675-4d58-9daf-699787425859 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.236020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.236272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.242509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.243198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.243482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.243999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/b24716bf96554627a4545da2a1fcbd74` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.246673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=056e6c0714cf4827a3b118d0bddfb182, role_id=b24716bf96554627a4545da2a1fcbd74)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.248168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aafe96-8cd0-4c00-8816-3536168c3e1c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.275990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 532/1074] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:07 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/056e6c0714cf4827a3b118d0bddfb182/roles/b24716bf96554627a4545da2a1fcbd74 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:04:07.299591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148474c8-01e1-45b7-8108-988a56702fa6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.300130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148474c8-01e1-45b7-8108-988a56702fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.300636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148474c8-01e1-45b7-8108-988a56702fa6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.303646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 533/1075] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:07.309364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.309713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.310091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.330536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:07.331905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:07.354129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277a9-277f-479e-83ac-dd0004bea39e None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.395766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.396444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.396735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.396990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.410642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:07.415735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:07.416870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:07.421111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 543/1076] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:07.424302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.436051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 534/1077] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:07.528468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.538782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed856-05d0-4d37-8e6e-61b4795dab61 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.575306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.575918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.576215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.576530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.577191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:07.577483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.578928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.588042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 544/1078] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:07.593553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.702905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5a2cb-e639-4563-b7f1-ac918dcdd76e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.706401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.733096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.754662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.755462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.755752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.756055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] PATH_INFO: `/v3/users/342b203c464043da8e2aa283bc88542c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.758140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] RBAC: Authorizing `identity:get_user(user_id=342b203c464043da8e2aa283bc88542c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.759683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.761908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 535/1079] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/users/342b203c464043da8e2aa283bc88542c => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.767315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.850329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c18b1-25b4-4a25-81e2-0c966615fb34 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.895800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.896035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07273b-0cc0-4f1b-8db6-d5c08b2bc78f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.896843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.897475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.897931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.929259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.933142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.934197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.934477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.934744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.935887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.937352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.939215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 536/1080] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.945126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.994400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.996390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.020096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.076256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300d77-3cb2-4f9a-94a0-65b94d00bcba None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.124836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 545/1081] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:08.125886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.130617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.131605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.132138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.132929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942/users/342b203c464043da8e2aa283bc88542c/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.137454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c714d1eaffd4f96addb79ab05e89942, user_id=342b203c464043da8e2aa283bc88542c, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.138910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.160059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 537/1082] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:07 2022] PUT /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942/users/342b203c464043da8e2aa283bc88542c/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:08.205374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.265027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d63ed-8eb2-46ae-bbc5-c19c4130648f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.304787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.305450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.305723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.305986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.318839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.320317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-978ab000-764d-43e3-a790-425716b60c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:08.341643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:08.342658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:08.343585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:08.343585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:08.343585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:08.343585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 546/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:08.347548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.462811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b6899-c7d8-4923-893c-5a3d490ef014 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.480073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.502123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.502729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.503007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.503277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.503935 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:08.504285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.505653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce280-a220-47ee-a530-875ee8acbc81 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.519231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 538/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:09.511113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa624-86f7-45c8-948f-743249bb633a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.511616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa624-86f7-45c8-948f-743249bb633a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.511616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa624-86f7-45c8-948f-743249bb633a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.512914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 547/1085] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:09.518499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.518932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.519044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.537304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:09.538486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:09.606646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 539/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:09.883751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa624-86f7-45c8-948f-743249bb633a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.023372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa624-86f7-45c8-948f-743249bb633a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.026271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.073117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.073798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.074073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.074341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.087879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:10.093077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:10.094634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:10.095489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 548/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:10.103943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.232042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae10a0e-a378-497d-b85f-946276138540 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.242055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.272518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.273135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.273408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.273675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.274371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:10.274671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.276067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c61c-1a80-40c7-847f-bce59df6efbf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.286036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 540/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:10.294599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.404904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df6f-bae9-48e7-a863-cb039ac24aac None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.435199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e648-d0a8-4980-bfaf-dc7cbeb8959c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.435443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e648-d0a8-4980-bfaf-dc7cbeb8959c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.435813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e648-d0a8-4980-bfaf-dc7cbeb8959c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.437212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 541/1089] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:10.440039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.440664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.440936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.441199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.443243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.443591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.443879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.453728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.455180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.462092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:10.463293 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:10.469990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:10.471042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:10.472658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:10.472658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:10.472658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:10.472658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 549/1090] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:10.476987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.501012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.540667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 542/1091] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:10.590904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d52b-66d9-485c-a00c-4269697d4654 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.629100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.629713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.629990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.630269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.630900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:10.631197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.632587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.644594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 550/1092] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:10.650253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.750731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.755301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75856-2072-47f0-816f-d3b183d7663c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.790763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.791402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.791698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.791953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.800065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.801505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:10.814017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:10.815214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:10.816369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:10.816991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.817250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 543/1093] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:10.820813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.898496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.923689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a8da-451a-40c1-b95a-761cc6130dd8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.928405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e4b0-a440-4d3b-8181-3506ef9fd68e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.957736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.958361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.958636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.958900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.962292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.962956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.963189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.963418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.964203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:10.964563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.965909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.969773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:10.974595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:10.976534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:10.978376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:10.980283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 551/1094] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:10.981897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.991174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 544/1095] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:10.992255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.010104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.093445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea28c2-0d11-42bc-97d5-ea7815eabb60 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.099898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a54df-55e2-41c1-979d-46f39b36c55f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.135071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.135687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.135984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.136249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.136641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.136912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:11.137207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.137307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.137507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.137776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.138548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.141284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.148102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 552/1096] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:11.153995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.214574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.216031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.236207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.260773 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3541e5-f009-478e-bc84-04b179161165 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.294470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.295092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.295364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.295639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] PATH_INFO: `/v3/users/342b203c464043da8e2aa283bc88542c` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.296804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] RBAC: Authorizing `identity:get_user(user_id=342b203c464043da8e2aa283bc88542c)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.298462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.300063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 553/1097] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/users/342b203c464043da8e2aa283bc88542c => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:11.305747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.316714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 545/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:11.322354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.371489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.413933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18295-7799-4df1-9148-c30d0ab13b16 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.425852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca8849-1d69-44ca-a154-458be5044744 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.442871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.447463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.448173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.448448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.448718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.461687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.462313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.462591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.462861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.472909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.474254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:11.488862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:11.489988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:11.490954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:11.490954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:11.490954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:11.490954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 546/1099] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:11.495560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.516777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.518140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.585426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.605225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0913a-6f5a-4c52-a9e5-e40ea885bc55 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.622272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 554/1100] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:11.639207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.642670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.643233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.643514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.643785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.644465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:11.644770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.646192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.660880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 547/1101] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:11.666818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.699637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.746847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c10b-1e1a-45dd-954f-6f6557fce62b None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.781552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75cca3-db1e-491f-9f3a-b779352128dc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.784393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.785072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.785348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.785617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.786805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.788274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.789962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 555/1102] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:11.796192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.819460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.820426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.820757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.821041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.827901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.829368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:11.840632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:11.842109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:11.843285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 548/1103] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:11.846469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.850541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.925123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeae61-e641-41f4-8626-3405466cdd53 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.950971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.963139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.963755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.964037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.964316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.965041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=4c714d1eaffd4f96addb79ab05e89942, user.id=342b203c464043da8e2aa283bc88542c) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:11.965348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.966551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f7eb-31b6-4232-a976-26dcd6f6cf5b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.966794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.988007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 556/1104] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/role_assignments?user.id=342b203c464043da8e2aa283bc88542c&scope.project.id=4c714d1eaffd4f96addb79ab05e89942&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:12.004467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.005110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.005388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.005655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.006368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:12.006668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.008181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7822707-e56d-4b3b-8b49-5fbb6b1ad3b3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.022124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 549/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:12.028665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.138045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.142222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95053-692d-47e0-81f9-d72349e6e069 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.185398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.186011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.186287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.186559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.187285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] RBAC: Adding query filter params (role.id=b24716bf96554627a4545da2a1fcbd74, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=056e6c0714cf4827a3b118d0bddfb182) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:12.187593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.189046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb50f07-afd6-49d6-a6f0-d21b2ee504c0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.195346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 557/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:12 2022] GET /identity/v3/role_assignments?user.id=056e6c0714cf4827a3b118d0bddfb182&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b24716bf96554627a4545da2a1fcbd74 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:14.203249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673a0c-b3f4-417d-a33a-ec27418b465d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.203748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673a0c-b3f4-417d-a33a-ec27418b465d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.203839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673a0c-b3f4-417d-a33a-ec27418b465d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.205148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 550/1107] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:14.210782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.211276 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.211376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.230033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:14.231228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:14.307532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 558/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:14.582708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5673a0c-b3f4-417d-a33a-ec27418b465d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.689589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5673a0c-b3f4-417d-a33a-ec27418b465d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.724727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.725361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.725636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.725907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.727015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.728469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2658ea-cc03-40dd-882e-bf9df60d6759 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.730059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 551/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:14.736433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.830433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.839688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ce20-03ff-4e88-8a49-3cdbf1401409 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.878742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.879536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.879814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.880120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.880803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.882314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6c61-4658-4c42-9b1c-6a4778fb9293 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.909009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 559/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:14 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:17.212051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622505-b532-49e0-8fbb-399f251c674b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.212595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622505-b532-49e0-8fbb-399f251c674b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.213004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622505-b532-49e0-8fbb-399f251c674b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.215242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 552/1111] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:17.221720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.222206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.222302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.241131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:17.242323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:17.311126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 560/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:17.581932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4622505-b532-49e0-8fbb-399f251c674b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.600660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.688968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4622505-b532-49e0-8fbb-399f251c674b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.723884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.724541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.724817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.725085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] PATH_INFO: `/v3/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.726460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] RBAC: Authorizing `identity:get_role(role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.727818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.729245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 553/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/roles/75e15a3f70704e038e150ee93dfacae2 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.735618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.815316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.837867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84ef7-4f35-4819-bdf2-9af3d273ba47 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.874809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.875447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.875724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.876019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] PATH_INFO: `/v3/users/381a2b5522a74cd08b05d468cd489d64` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.890378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=381a2b5522a74cd08b05d468cd489d64)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.891824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.893560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 561/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/users/381a2b5522a74cd08b05d468cd489d64 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.899459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.987207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.004971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efe70e-a803-4381-bd2f-47e7c4f35dd7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.042610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.043206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.043477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.043741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.116222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.117700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.209825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.227768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 554/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:18.234379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.339919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfcc67-8885-4f58-acf3-015bbefd4bd2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.378920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.379451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.379734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.380027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.381216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.382645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e224-017d-4bbe-9ae5-92648c22615f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.384600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 562/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:18.392523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.507709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965eba4-5a30-4703-b994-a65d5a3d1f2b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.548071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.548676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.548949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.549212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.549939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=4c714d1eaffd4f96addb79ab05e89942, user.id=381a2b5522a74cd08b05d468cd489d64) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:18.550236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.551654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399836-11be-4bb4-8ec7-56014128cbe4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.557726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 555/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/role_assignments?user.id=381a2b5522a74cd08b05d468cd489d64&scope.project.id=4c714d1eaffd4f96addb79ab05e89942&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:20.750926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def1eb-10d0-425d-a080-3d0c044d3b66 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.751497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def1eb-10d0-425d-a080-3d0c044d3b66 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.751497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def1eb-10d0-425d-a080-3d0c044d3b66 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.752998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 563/1118] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:20.758716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.759206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.759355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.782987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:20.784237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:20.833775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.861536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 556/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:21.131304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def1eb-10d0-425d-a080-3d0c044d3b66 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:21.135142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:21.238926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def1eb-10d0-425d-a080-3d0c044d3b66 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:21.273590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:21.274216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:21.274492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:21.274763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] PATH_INFO: `/v3/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:21.276194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] RBAC: Authorizing `identity:get_role(role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:21.277546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:21.279400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 564/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:21 2022] GET /identity/v3/roles/75e15a3f70704e038e150ee93dfacae2 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:21.285941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:21.385459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f89b5-a4bc-4937-a6ac-169e9228d49b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:21.422305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:21.422943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:21.423223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:21.423497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] PATH_INFO: `/v3/users/381a2b5522a74cd08b05d468cd489d64` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:21.424607 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] RBAC: Authorizing `identity:get_user(user_id=381a2b5522a74cd08b05d468cd489d64)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:21.426049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:21.427711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 557/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:21 2022] GET /identity/v3/users/381a2b5522a74cd08b05d468cd489d64 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:21.433902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:21.511984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:21.544364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8fb2-5e3d-4111-97c6-2ce2a5168e14 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:21.586943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:21.587615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:21.587921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:21.588304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:21.589855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:21.591934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978b5a7-8108-4f51-b844-49d0d5e4dd0b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:21.593721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 565/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:21 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:21.600026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:21.653538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:21.718188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3407-bb7d-49a3-85b4-1f37bcd62dde None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:21.754337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:21.755010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:21.755288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:21.755567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942/users/381a2b5522a74cd08b05d468cd489d64/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:21.757830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c714d1eaffd4f96addb79ab05e89942, user_id=381a2b5522a74cd08b05d468cd489d64, role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:21.759295 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d69564-f9fd-4971-9e1b-ed76d1adc984 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:21.774559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 558/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:21 2022] PUT /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942/users/381a2b5522a74cd08b05d468cd489d64/roles/75e15a3f70704e038e150ee93dfacae2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:23.995126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59c6c-1ce8-4ff4-ac52-7ea518cf1626 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:23.995759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59c6c-1ce8-4ff4-ac52-7ea518cf1626 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:23.995759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59c6c-1ce8-4ff4-ac52-7ea518cf1626 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:23.997042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 566/1124] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:24.005363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.005924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.005924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.026191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:24.027452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:24.099582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 559/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:24.371912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c59c6c-1ce8-4ff4-ac52-7ea518cf1626 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.488685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c59c6c-1ce8-4ff4-ac52-7ea518cf1626 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.525204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.525925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.526245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.526558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] PATH_INFO: `/v3/roles/75e15a3f70704e038e150ee93dfacae2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.528108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] RBAC: Authorizing `identity:get_role(role_id=75e15a3f70704e038e150ee93dfacae2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.529566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.531068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 567/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/roles/75e15a3f70704e038e150ee93dfacae2 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:24.537273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.576190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.653275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ccd6a-7a9e-43eb-89ec-94bf1476f51a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.693159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.693874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.694397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.694729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] PATH_INFO: `/v3/users/381a2b5522a74cd08b05d468cd489d64` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.696186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] RBAC: Authorizing `identity:get_user(user_id=381a2b5522a74cd08b05d468cd489d64)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.697888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.699748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 560/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/users/381a2b5522a74cd08b05d468cd489d64 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:24.706711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.719617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.830144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5e1aa-5d20-4f90-8126-d50525801bac None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.867455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.868091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.868369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.868638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.942055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.943409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.955291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.058075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 568/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:25.065553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.179816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757b969-bbac-4e92-947c-9d71e64a53ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.182592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.218341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.218880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.219159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.219431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] PATH_INFO: `/v3/projects/4c714d1eaffd4f96addb79ab05e89942` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.220576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c714d1eaffd4f96addb79ab05e89942)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.222013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eacbc-519d-4fae-a453-f62cdc62ffd8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.223666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 561/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:25 2022] GET /identity/v3/projects/4c714d1eaffd4f96addb79ab05e89942 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:25.230230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.342379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593a71-d244-479a-81c8-fbcc3e98cb70 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.353832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.396905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.397815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.398241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.398649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.399902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] RBAC: Adding query filter params (role.id=75e15a3f70704e038e150ee93dfacae2, scope.project.id=4c714d1eaffd4f96addb79ab05e89942, user.id=381a2b5522a74cd08b05d468cd489d64) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:25.400466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.403085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4c06e-e0bb-4ebd-b8b4-a7b8076e05ea None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.414592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 569/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:25 2022] GET /identity/v3/role_assignments?user.id=381a2b5522a74cd08b05d468cd489d64&scope.project.id=4c714d1eaffd4f96addb79ab05e89942&role.id=75e15a3f70704e038e150ee93dfacae2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:27.687669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a525-1d3f-475e-baf5-93beca2e2a00 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:27.688412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a525-1d3f-475e-baf5-93beca2e2a00 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:27.688412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a525-1d3f-475e-baf5-93beca2e2a00 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:27.689783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 562/1131] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:27.695813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:27.696397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:27.696397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:27.715587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:27.716812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:27.789087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 570/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:28.180447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a525-1d3f-475e-baf5-93beca2e2a00 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.291689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a525-1d3f-475e-baf5-93beca2e2a00 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.328438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.329082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.329360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.329630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.330816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:28.332283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c347-618d-4bcc-8217-9979d9233a7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:28.333921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 563/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:28.340667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.448610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0fe1-56a9-489c-8c8a-709b9fa58873 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.450724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.489069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.489692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.489969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.490232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.490903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:28.492410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e336-3567-41ba-bd4f-2edd57cb980d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:28.522511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 571/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:04:28 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:30.814431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03da8d-fece-4128-9d4e-192c442602a7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.814983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03da8d-fece-4128-9d4e-192c442602a7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.814983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03da8d-fece-4128-9d4e-192c442602a7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.816343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 564/1135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:30.822545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.823082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.823082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.846626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:30.849412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:30.930644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 572/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:31.205195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03da8d-fece-4128-9d4e-192c442602a7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.254539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.332173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03da8d-fece-4128-9d4e-192c442602a7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.382327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.382962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.383243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.383515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.384693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.386151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb1eca-c1e1-4324-afa1-899f4d5210ab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.388409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 565/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.394458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.492493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.513794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d6581-4507-4530-950c-92e25b6ee39a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.552786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.553409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.553689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.553991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.554681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.556206 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc22fd-99bb-43b6-8ec8-e355e39b990a None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.580686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 573/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:31 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:33.970175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785722b-2951-4165-a4c9-4327a5d9099e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:33.970719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785722b-2951-4165-a4c9-4327a5d9099e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:33.970809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785722b-2951-4165-a4c9-4327a5d9099e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:33.972235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 566/1139] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:33.978321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:33.978868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:33.978868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:33.998180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:33.999372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:34.075688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 574/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:34.350401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785722b-2951-4165-a4c9-4327a5d9099e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:34.467505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785722b-2951-4165-a4c9-4327a5d9099e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:34.477691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:34.506877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:34.507617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.507980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.508292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.519749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:34.524825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:34.526903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:34.528539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 567/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:34.534765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:34.608789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:34.643050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796641-2a65-4642-a358-cfcde3aec6e5 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:34.682438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:34.683122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.683488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.683884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.684684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:34.685030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:34.686470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:34.695927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 575/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:34.702509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:34.816350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6d04-b638-47f6-b164-9e2a3cf78cfd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:34.853463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:34.854103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.854384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.855254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] PATH_INFO: `/v3/users/5524054531aa45469f00245f9db87cf7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.870879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=5524054531aa45469f00245f9db87cf7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:34.872269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:34.874003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 568/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/users/5524054531aa45469f00245f9db87cf7 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:34.880188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:34.996829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddcd4b-0f55-4994-a831-4aa20b33ac03 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.029738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.035198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.035807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.036116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.036381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.115094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.117027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.222364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 576/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:04:35.232383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.266414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.348929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b3a7f-ee18-4d82-87c8-d7738880c2b2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.388328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.388963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.389238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.389504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] PATH_INFO: `/v3/projects/765987c317fc490cb74e0ed6893e5dd6` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.390681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] RBAC: Authorizing `identity:get_project(project_id=765987c317fc490cb74e0ed6893e5dd6)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.392155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8fdd4-82c6-47e9-bcab-2d20dd08bb23 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.393867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 569/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/projects/765987c317fc490cb74e0ed6893e5dd6 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:35.400298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.434312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.511380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b5ed-ce69-48c2-bc10-5531e5c5ebe0 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.548398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.549013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.549285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.549549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.550284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=765987c317fc490cb74e0ed6893e5dd6, user.id=5524054531aa45469f00245f9db87cf7) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:35.550587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.552068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f9e47-9872-4f36-bbbd-293b8c6a67f0 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.559045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 577/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/role_assignments?user.id=5524054531aa45469f00245f9db87cf7&scope.project.id=765987c317fc490cb74e0ed6893e5dd6&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:37.854988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5819-c79a-448f-9e39-03b3a2f427bb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.855559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5819-c79a-448f-9e39-03b3a2f427bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.855559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5819-c79a-448f-9e39-03b3a2f427bb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.856939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 570/1147] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:37.863010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.863571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.863571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.883727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:37.885055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:37.960202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 578/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:38.238765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c5819-c79a-448f-9e39-03b3a2f427bb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.346236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.355832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c5819-c79a-448f-9e39-03b3a2f427bb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.394262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.394900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.395182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.395456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.407558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:38.412850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:38.414695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:38.416361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 571/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:38.425105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.455259 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.543458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f943e-4d62-4f11-8b91-6792ede788a4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.579171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.579795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.580107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.580375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.581051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.581350 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.582730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.592659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 579/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.600049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.717195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459bee-2592-4431-8cfc-8943adf36000 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.755235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.755870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.756168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.756433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] PATH_INFO: `/v3/users/5524054531aa45469f00245f9db87cf7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.757599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] RBAC: Authorizing `identity:get_user(user_id=5524054531aa45469f00245f9db87cf7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.759046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.761325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 572/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/users/5524054531aa45469f00245f9db87cf7 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.767473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.867076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.883842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4e61-3540-46f9-84e1-9f6cc759dd09 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.924942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.925597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.925875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.926149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] PATH_INFO: `/v3/projects/765987c317fc490cb74e0ed6893e5dd6` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.927381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] RBAC: Authorizing `identity:get_project(project_id=765987c317fc490cb74e0ed6893e5dd6)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.928916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a493b-a523-4afd-86a1-d3eba0db9a47 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.930685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 580/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/projects/765987c317fc490cb74e0ed6893e5dd6 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.938220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.973866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.057515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79134-1a53-4f51-b0e6-802274a0bc1f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.095572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.096272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.096614 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.096897 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] PATH_INFO: `/v3/projects/765987c317fc490cb74e0ed6893e5dd6/users/5524054531aa45469f00245f9db87cf7/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.098896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] RBAC: Authorizing `identity:create_grant(project_id=765987c317fc490cb74e0ed6893e5dd6, user_id=5524054531aa45469f00245f9db87cf7, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.100386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038814-f177-47fd-bdb6-bf497552dafe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.116059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 573/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:38 2022] PUT /identity/v3/projects/765987c317fc490cb74e0ed6893e5dd6/users/5524054531aa45469f00245f9db87cf7/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:41.359153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf268c9-7193-4142-95b7-9731bd8975ec None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.359695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf268c9-7193-4142-95b7-9731bd8975ec None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.359695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf268c9-7193-4142-95b7-9731bd8975ec None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.361089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 581/1154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:41.367173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.367666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.367818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.388605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:41.389881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:41.464056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 574/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:41.741046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf268c9-7193-4142-95b7-9731bd8975ec None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.851860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf268c9-7193-4142-95b7-9731bd8975ec None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.888156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.888789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.889065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.889334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.901550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:41.906444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:41.908214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:41.909816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 582/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:41.913936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.929894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.029346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620576b9-1f68-4b14-958e-1925fa34af8b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.068239 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.068861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.069139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.069408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.070083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:42.070384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.071765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.080933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 575/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:42.091371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.124571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.237852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc677-0a19-4a15-a97d-52a563e44674 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.277605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.278334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.278610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.279107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] PATH_INFO: `/v3/users/5524054531aa45469f00245f9db87cf7` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.280493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] RBAC: Authorizing `identity:get_user(user_id=5524054531aa45469f00245f9db87cf7)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.281910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.283616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 583/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/users/5524054531aa45469f00245f9db87cf7 => generated 286 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:42.294671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.391100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.424018 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e34fe4-4e66-4370-91fa-ad80f991cf42 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.475931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.476605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.476889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.477159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.554225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.555722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.638951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.669969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 576/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:42.680016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.825678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.843802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c59664-f330-4d1b-8d59-91f854e53841 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.879524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.880191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.880467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.880734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] PATH_INFO: `/v3/projects/765987c317fc490cb74e0ed6893e5dd6` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.881905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] RBAC: Authorizing `identity:get_project(project_id=765987c317fc490cb74e0ed6893e5dd6)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.883329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad93770-f52d-429e-9e25-730eebb162dc None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.885699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 584/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/projects/765987c317fc490cb74e0ed6893e5dd6 => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:42.895297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.009409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbba493-d908-496a-85f4-6d459bac6b3b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.049958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.050569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.050904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.051178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.051915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=765987c317fc490cb74e0ed6893e5dd6, user.id=5524054531aa45469f00245f9db87cf7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.052257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.053700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6351-7307-4eff-8dd1-9f6a9f86be47 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.060855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 577/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/role_assignments?user.id=5524054531aa45469f00245f9db87cf7&scope.project.id=765987c317fc490cb74e0ed6893e5dd6&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:45.348583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdc30d-c287-4bce-81f6-96cdc389fb2a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.349131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdc30d-c287-4bce-81f6-96cdc389fb2a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.349225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdc30d-c287-4bce-81f6-96cdc389fb2a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.350642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 585/1162] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:45.356405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.356858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.356951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.375591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:45.376822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:45.407372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.446515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 578/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:45.716930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdc30d-c287-4bce-81f6-96cdc389fb2a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.826761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdc30d-c287-4bce-81f6-96cdc389fb2a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.864454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.865076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.865352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.865620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.889728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.942483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.943938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.053308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 586/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:46.062996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.198205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761183-55cb-4c6d-bb5a-c1dd569e40bf None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.234313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.234952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.235226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.235489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.242466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.243929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2903ae67-3f12-4cf7-a016-a8eb16d3c917 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:46.256288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:46.264340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:04:46.265983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 579/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:46.267528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.357209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.413714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508e12-65d0-49ae-9abd-6976d3d49a2d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.452245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.452847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.453117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.453380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.454024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.454318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.455669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3db21-82a0-45a4-89ef-8d717c633788 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.464324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 587/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:48.685620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d11790-0199-4b69-9d3f-88ed997a8326 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.686149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d11790-0199-4b69-9d3f-88ed997a8326 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.686149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d11790-0199-4b69-9d3f-88ed997a8326 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.687501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 580/1167] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:48.693084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcee-8290-4641-baf0-fab3385656c0 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.693486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcee-8290-4641-baf0-fab3385656c0 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.693627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcee-8290-4641-baf0-fab3385656c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.712204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e6debcee-8290-4641-baf0-fab3385656c0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:48.713441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e6debcee-8290-4641-baf0-fab3385656c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:48.795161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 588/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:49.071761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d11790-0199-4b69-9d3f-88ed997a8326 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.122796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:49.226079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d11790-0199-4b69-9d3f-88ed997a8326 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.264077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.264687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.264962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.265228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.265908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.267280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e50946-7bb5-4d65-a9ea-3eddc74ea017 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.285887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 581/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Sep 13 12:04:49 2022] POST /identity/v3/domains => generated 267 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:51.521822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44c34-33d1-432f-94f1-5bffc1006241 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:51.522338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44c34-33d1-432f-94f1-5bffc1006241 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:51.522338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44c34-33d1-432f-94f1-5bffc1006241 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:51.523617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 589/1170] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:51.529464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:51.529977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:51.530084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:51.550896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:51.552267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:51.623468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 582/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:51.899903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44c34-33d1-432f-94f1-5bffc1006241 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:51.953950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.013776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44c34-33d1-432f-94f1-5bffc1006241 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:52.055904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:52.056580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.056855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.057660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] PATH_INFO: `/v3/domains/3014d061e7ad497ca8c27ce266ee3c1d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.069913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=3014d061e7ad497ca8c27ce266ee3c1d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:52.071374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92f8f8-cdf3-42f7-bfac-f3fb0e75c8bd None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:52.073738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 590/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Sep 13 12:04:51 2022] GET /identity/v3/domains/3014d061e7ad497ca8c27ce266ee3c1d => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:52.079945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:52.099371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.195091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fca147-65e1-4646-89c3-3d3a4601123c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:52.234172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:52.234794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.235071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.235337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.236028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:52.237485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b43e-8be9-42a1-be76-0e30ef38f36a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:52.268467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 583/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:04:52 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:54.566484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f9054-69f3-4cb0-854a-ae393e200f14 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.567122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f9054-69f3-4cb0-854a-ae393e200f14 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.567122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f9054-69f3-4cb0-854a-ae393e200f14 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.568500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 591/1174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:54.574976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.575528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.575528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.595210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:54.596502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:54.670101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:54.676985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 584/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:54.959320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f9054-69f3-4cb0-854a-ae393e200f14 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:55.076167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f9054-69f3-4cb0-854a-ae393e200f14 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:55.088574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:55.125929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:55.126562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:55.126837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:55.127103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] PATH_INFO: `/v3/domains/3014d061e7ad497ca8c27ce266ee3c1d` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:55.128310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3014d061e7ad497ca8c27ce266ee3c1d)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:55.129744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6cc16-658d-414d-be66-7414f6fb21e6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:55.131377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 592/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Sep 13 12:04:54 2022] GET /identity/v3/domains/3014d061e7ad497ca8c27ce266ee3c1d => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:55.138246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:55.252879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27260548-cb37-49e4-9eed-8bcfc025679e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:55.290377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:55.290994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:55.291273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:55.292130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:55.292809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:55.294248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4cd4f-01e7-45dc-b119-8f7c39b3b2ca None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:55.320130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 585/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:55 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:57.636735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048bbd5-45cb-4451-a0f0-e9045f6b3959 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.637297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048bbd5-45cb-4451-a0f0-e9045f6b3959 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.637297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048bbd5-45cb-4451-a0f0-e9045f6b3959 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.638646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 593/1178] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:57.644781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.645336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.645437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.665063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:57.666296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:57.720581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:57.740588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 586/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:58.014267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048bbd5-45cb-4451-a0f0-e9045f6b3959 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.165709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048bbd5-45cb-4451-a0f0-e9045f6b3959 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.201946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.202596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.202871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.203141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.215013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:58.220069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:58.221894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:04:58.223555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 594/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:58.227831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.338695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab649b-bca6-44d7-970c-bf6535fdf681 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.377438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.378178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.378550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.378916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.379688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:58.380134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.381608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.390695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 587/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:58.400216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.439996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.513043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59e4d-3d96-41ee-914d-8e1018067697 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.550179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.550798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.551075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.551413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] PATH_INFO: `/v3/users/ec9aeb735ed9402598f72515db11edbe` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.566120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9aeb735ed9402598f72515db11edbe)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.567563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.569297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 595/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/users/ec9aeb735ed9402598f72515db11edbe => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:58.575212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.626333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.678984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc5cb-b790-4c13-ab33-f5508286cc35 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.712419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.713035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.713318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.714122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.783333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.786685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.835882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.889887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 588/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:58.895928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.990007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.998700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad000-f4c1-4d7a-9f24-c181e1975c53 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.033844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.034490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.034778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.035042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] PATH_INFO: `/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.036237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b13cce10b9b84f0c8d5b8b88264cf78c)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.037682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97277af5-30af-42fb-95d1-66e10923a1e7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.039396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 596/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:59.046268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:59.163740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8ee2-02a7-4897-925b-d3329fc71ffb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.201042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.201656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.201931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.202198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.203170 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=b13cce10b9b84f0c8d5b8b88264cf78c, user.id=ec9aeb735ed9402598f72515db11edbe) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:59.203523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.205222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31ee6-12d8-4508-bb7f-ab203a322a0a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.211403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 589/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:59 2022] GET /identity/v3/role_assignments?user.id=ec9aeb735ed9402598f72515db11edbe&scope.project.id=b13cce10b9b84f0c8d5b8b88264cf78c&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:01.423530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001335d-6da3-4cef-99ca-254856c28444 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.424151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001335d-6da3-4cef-99ca-254856c28444 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.424151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001335d-6da3-4cef-99ca-254856c28444 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.425409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 597/1186] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:01.431529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.432102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.432102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.451244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:01.452491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:01.460869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:01.521891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 590/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:01.795611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001335d-6da3-4cef-99ca-254856c28444 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.905402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001335d-6da3-4cef-99ca-254856c28444 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:01.941966 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:01.942595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.942872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.943146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.953955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:05:01.958798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:01.959922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:05:01.960991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 598/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:01.966868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.076144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571bbd4-b632-4385-87a8-fef2583da64b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.113591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.114217 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.114497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.114767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.115449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:02.115751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.117152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.126078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 591/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:02.136694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.165627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.243757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b20e48-1f24-47d2-bd78-565ba65af07a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.278346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.278964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.279243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.279505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] PATH_INFO: `/v3/users/ec9aeb735ed9402598f72515db11edbe` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.280632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9aeb735ed9402598f72515db11edbe)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.282031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.283599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 599/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:05:02 2022] GET /identity/v3/users/ec9aeb735ed9402598f72515db11edbe => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:02.289516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.293322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.391334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099f4a-c350-46f2-b545-c5969f843266 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.424578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.425208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.425486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.425757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] PATH_INFO: `/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.426899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] RBAC: Authorizing `identity:get_project(project_id=b13cce10b9b84f0c8d5b8b88264cf78c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.428347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3046-74c4-447d-bbf0-1f50cff4e841 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.430010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 592/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:05:02 2022] GET /identity/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:02.437006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.528500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.541582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ca2d-9743-4e5a-b76b-6c5948aac7f1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.579511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.580194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.580468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.580732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] PATH_INFO: `/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c/users/ec9aeb735ed9402598f72515db11edbe/roles/83fb245122344892b0377532854af000` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.582666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b13cce10b9b84f0c8d5b8b88264cf78c, user_id=ec9aeb735ed9402598f72515db11edbe, role_id=83fb245122344892b0377532854af000)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.584128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6690945-7b92-470c-bc19-cd0a591a27d2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.597557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 600/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:05:02 2022] PUT /identity/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c/users/ec9aeb735ed9402598f72515db11edbe/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:05:04.839308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54893-0147-4936-88b2-6d0ba95f47bd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.839872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54893-0147-4936-88b2-6d0ba95f47bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.840282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54893-0147-4936-88b2-6d0ba95f47bd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.842516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 593/1193] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:04.849367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.849869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.849964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.869388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:04.871103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:04.939673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 601/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:05.210945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54893-0147-4936-88b2-6d0ba95f47bd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.307017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.341254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54893-0147-4936-88b2-6d0ba95f47bd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.394020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.394667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.394949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.395220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.407137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:05:05.412070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:05.413949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:05:05.415663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 594/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:05.420762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.505565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.531777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162cfa-5ef7-41e9-8d56-6c4418c8a3e7 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.568808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.569477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.569754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.570023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.570694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:05.570991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.572389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:05.581708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 602/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:05.587749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.694528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c00b92-5104-4310-bf4f-4fd93651dfd6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.726088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.732539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.733176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.733450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.733718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] PATH_INFO: `/v3/users/ec9aeb735ed9402598f72515db11edbe` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.734879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9aeb735ed9402598f72515db11edbe)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.736343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:05.737950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 595/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/users/ec9aeb735ed9402598f72515db11edbe => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:05.744142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.866554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf061-f5f7-4884-88e1-5fa08587eedf None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.900632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.901855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.902240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.902565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.915299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.990423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.991883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.099764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 603/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:05:06.107908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:06.216203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9513a-c9a8-49c3-a546-3514083613a6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:06.254481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:06.255035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.255314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.255587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] PATH_INFO: `/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.256805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] RBAC: Authorizing `identity:get_project(project_id=b13cce10b9b84f0c8d5b8b88264cf78c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:06.258261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff77df-0791-4eca-bad7-56b1e1006197 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.259988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 596/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 12:05:06 2022] GET /identity/v3/projects/b13cce10b9b84f0c8d5b8b88264cf78c => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:06.267142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:06.312788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:06.375341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ca53-1ee7-4c4c-9f00-f2a967f372ca None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:06.412562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:06.413173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.413450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.413723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.414454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=b13cce10b9b84f0c8d5b8b88264cf78c, user.id=ec9aeb735ed9402598f72515db11edbe) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:06.414760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:06.416223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02fc86-6942-40d9-a861-fed4db9614e5 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.423087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 604/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:05:06 2022] GET /identity/v3/role_assignments?user.id=ec9aeb735ed9402598f72515db11edbe&scope.project.id=b13cce10b9b84f0c8d5b8b88264cf78c&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:16.249769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=66 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:16.420831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=48 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:07.167672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a740-0041-47a1-a815-036baf105934 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:07.168226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a740-0041-47a1-a815-036baf105934 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:07.168226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a740-0041-47a1-a815-036baf105934 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:07.170064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 597/1201] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:06:07.178963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:07.178963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:07.178963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:07.208461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:07.209722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:07.327716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 605/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:06:07.740793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a740-0041-47a1-a815-036baf105934 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:07.946717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a740-0041-47a1-a815-036baf105934 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:08.002959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:08.003570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:08.003898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:08.004222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:08.024232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:08.026491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:08.046898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:08.049346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:08.051495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:08.051495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:08.051495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:08.051495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 598/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:08.054891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:08.236775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9a93-0c23-4bbe-9699-212cfd03ab86 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:08.299543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:08.307549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:08.308591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:08.309089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:08.309568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:08.310474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:08.310988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:08.312756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e8e-68e2-4adb-b8b8-8b4acb67fc2b None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:08.328385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 606/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:08.334359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:08.409316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:08.501445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633677-8226-46cf-a56b-d40de9c820d5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:08.571477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:08.572177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:08.572594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:08.572912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:08.573864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:08.576484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7cc0-1a0f-43b4-af3e-97cc6259726e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:08.607904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 599/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 12:06:08 2022] POST /identity/v3/users => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:06:11.200764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9113bd-9f41-45ad-ae1a-2c5b4743b303 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:11.201770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9113bd-9f41-45ad-ae1a-2c5b4743b303 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:11.201770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9113bd-9f41-45ad-ae1a-2c5b4743b303 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:11.202957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 607/1206] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:11.209575 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:11.210109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:11.210956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:11.232371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:11.233758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:11.331136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 600/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:11.822775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9113bd-9f41-45ad-ae1a-2c5b4743b303 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:12.006702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9113bd-9f41-45ad-ae1a-2c5b4743b303 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:12.074946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:12.075164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:12.075635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:12.076172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:12.098764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:12.108312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:12.109387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:12.110252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:12.110943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 608/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:12.119003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:12.190160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:12.291651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc52c4-2185-4c20-b67f-d5191a8b5bb8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:12.348661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:12.349333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:12.349844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:12.350320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:12.351381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:12.352092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:12.354114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:12.368200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 601/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:12.374278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:12.442291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:12.520744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263d6c-f052-4697-8856-31377e6a595a None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:12.588509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:12.589591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:12.590116 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:12.590594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:12.613553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:12.616322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:12.655481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:12.657194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:12.659734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:12.659734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:12.659734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:12.659734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 609/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:12.669317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:12.844708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:12.848381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b44c5-952f-4392-804d-3891135ea656 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:12.890246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:12.890810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:12.891230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:12.891498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:12.892285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:12.892574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:12.894145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:12.909882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 602/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:12.919786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:13.089529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628abb4-aa4f-41fe-86dc-15bb7b41f0d7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:13.092369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:13.143828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:13.144530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:13.144816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:13.145122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:13.159641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:13.162283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:13.182925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:13.184233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:13.185336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:13.192240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 610/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:13.194444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:13.343261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da159982-e86f-4726-8469-6630ea0dcaa9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:13.404137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:13.404137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:13.404137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:13.405280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:13.406074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:13.406377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:13.408497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:13.436353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 603/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:13.442735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:13.570366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35061fd-cda3-4600-b0a7-3d468b03741c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:13.614404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:13.615053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:13.615306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:13.615574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:13.654974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:13.715141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:13.716673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:13.848756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 611/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:13.855658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:13.885795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:13.989324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870cc13-9323-4402-b619-8e6da83bd93e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:14.033983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:14.034770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:14.035174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:14.035540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:14.050710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:14.052309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:14.081500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:14.082815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:14.084141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:14.084141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:14.084141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:14.084141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 604/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:14.090499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:14.194424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:14.263005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4747b-ea72-4a78-8eaa-8885b7c04536 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:14.304032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:14.304692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:14.304971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:14.305243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:14.305932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:14.306235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:14.307654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:14.321664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 612/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:14.331019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:14.426273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:14.468409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ede7-1bce-4179-9e36-c1c9499e788a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:14.512791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:14.513951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:14.514381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:14.514845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:14.528692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:14.532231 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:14.559050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:14.560553 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:14.562581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 605/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:14.567562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:14.694109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c808e5-f2b5-4381-8722-c2fa57676227 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:14.725850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:14.744238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:14.745192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:14.745632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:14.746083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:14.747266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:14.747602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:14.749657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a927d-3291-4db1-9f01-a213c2dfac96 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:14.769269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 613/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:14.777608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:14.944501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe9dc2-d0b6-4af4-b39d-997bb084638a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:14.995520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:15.004241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:15.005143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:15.005580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:15.006027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:15.006951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7e4b73d8301942e09c8430d3529ab769) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:15.007299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:15.008814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8aedc-ee59-4c95-91fd-7e277495fba4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:15.015586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 606/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:14 2022] GET /identity/v3/role_assignments?user.id=7e4b73d8301942e09c8430d3529ab769&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:17.533012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932fa6-1487-453d-b017-d20ccc1ac84a None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:17.533795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932fa6-1487-453d-b017-d20ccc1ac84a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:17.533795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932fa6-1487-453d-b017-d20ccc1ac84a None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:17.535153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 614/1220] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:06:17.541519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:17.542226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:17.542226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:17.571040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:17.573083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:17.693672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 607/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:06:17.981108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932fa6-1487-453d-b017-d20ccc1ac84a None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:18.104269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932fa6-1487-453d-b017-d20ccc1ac84a None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:18.147174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:18.148632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:18.148980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:18.149319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:18.163871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:18.172238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:18.173216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:18.174107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 615/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:18.180477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:18.312654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963076e9-230c-4d5b-afa3-fd339c9ab1dc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:18.356804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:18.372051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:18.372750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:18.373102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:18.373450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:18.374196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:18.374564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:18.376117 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:18.386086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 608/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:18.393647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:18.461190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:18.546663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a7a4-a10b-4a3e-af04-97ddbd19f43d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:18.598218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:18.598789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:18.599061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:18.599323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:18.611272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:18.612772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:18.649386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:18.651506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:18.652580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:18.652580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:18.652580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:18.652580 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 616/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:18.657612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:18.825023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757dc1f-1522-45d8-808b-98d146759028 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:18.877091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:18.877692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:18.877974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:18.878287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:18.879061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:18.879417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:18.881271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:18.900104 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 609/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:18.903265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:19.051484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:19.062186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a87c3-ffdd-4e90-a01c-bd7cd69ecaf2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:19.118093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:19.119112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:19.119484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:19.119829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:19.131129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:19.133532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:19.153322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:19.154374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:19.155337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:19.155900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 617/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:19.165648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:19.243356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:19.313110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24c3b-c723-46c5-86da-2ac3e0680e7a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:19.370075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:19.371081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:19.371560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:19.372121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:19.373093 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:19.373467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:19.375458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:19.406612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 610/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:19.413005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:19.561728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4c60-4ca2-4e36-a7d5-e3912a6596e6 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:19.603695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:19.604430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:19.604705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:19.605026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:19.617188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:19.618639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:19.634889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:19.636913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:19.638620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:19.638620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:19.638620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:19.638620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 618/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:19.644055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:19.777690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58235-fd98-4369-91e9-931b1e0aad44 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:19.780270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:19.816969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:19.817587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:19.817863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:19.818129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:19.818800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:19.819096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:19.820564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:19.836609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 611/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:19.843330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:19.854426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:20.008625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215dd1-a268-4d62-ac61-a291b349d03f None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:20.058748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:20.059805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:20.061862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:20.061862 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:20.071771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:20.073601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:20.093108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:20.094092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:20.095177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 619/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:20.101417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:20.252888 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9985-ac4d-4cfc-a60f-f700fb227b08 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:20.302592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:20.303296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:20.303750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:20.304089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:20.305024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:20.305358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:20.307086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fe46-b708-456b-a089-fca28ad9d574 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:20.322535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 612/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:20.329923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:20.415992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:20.471380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999424d2-dedd-48cd-9e56-5ca24f3473ab None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:20.521122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:20.521818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:20.522123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:20.522527 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7e4b73d8301942e09c8430d3529ab769/roles/b5c6d777c01e412fadb11c5cefc4bbd2` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:20.546528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=7e4b73d8301942e09c8430d3529ab769, role_id=b5c6d777c01e412fadb11c5cefc4bbd2)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:20.548342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306ceaf-8369-4564-8835-93bca45418ad None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:20.567332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 620/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:06:20 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7e4b73d8301942e09c8430d3529ab769/roles/b5c6d777c01e412fadb11c5cefc4bbd2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:06:22.868803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb4c3-2ba6-42c3-80ba-e868c173321c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:22.869702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb4c3-2ba6-42c3-80ba-e868c173321c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:22.869702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb4c3-2ba6-42c3-80ba-e868c173321c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:22.871814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 613/1233] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:22.879869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94861e-833c-4750-952e-36360216ebd9 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:22.880521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94861e-833c-4750-952e-36360216ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:22.881017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94861e-833c-4750-952e-36360216ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:22.903900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-da94861e-833c-4750-952e-36360216ebd9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:22.906034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-da94861e-833c-4750-952e-36360216ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:23.037725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 621/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:23.418077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb4c3-2ba6-42c3-80ba-e868c173321c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:23.453476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:23.580874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb4c3-2ba6-42c3-80ba-e868c173321c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:23.624114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:23.624755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:23.625030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:23.625296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:23.637793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:23.642900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:23.644809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:23.646402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 614/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:23.651679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94861e-833c-4750-952e-36360216ebd9 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:23.717248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:23.818244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94861e-833c-4750-952e-36360216ebd9 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:23.881994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:23.883140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:23.883586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:23.884073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:23.885030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:23.885373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:23.887326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:23.902768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 622/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:23.913055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:24.095992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:24.139227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921b4c-f1df-4872-aaa5-48fb85def29b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:24.209070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:24.210192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:24.210678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:24.211162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:24.232100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:24.235169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:24.269694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:24.271732 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:24.273022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:24.273022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:24.273022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:24.273022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 615/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:24.285381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:24.488570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840eb48-0f25-4903-92b3-41d29cbcec75 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:24.507053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:24.552964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:24.554500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:24.554934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:24.555540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:24.556425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:24.556786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:24.558499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:24.575578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 623/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:24.582496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:24.738176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3126f0e-77cb-410c-8ea7-3d135a6e3daa None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:24.785435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:24.785970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:24.786238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:24.786539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:24.790954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:24.797865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:24.799864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:24.812812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:24.814048 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:24.815512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 616/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:24.820685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:24.976806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57020165-ca34-42d3-ab0a-777271894fd9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:25.036491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:25.037448 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:25.038557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:25.039058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:25.040557 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:25.041032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:25.044269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:25.068955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 624/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:25.082063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:25.254892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f733-a631-4301-8638-179dbf991ae5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:25.305502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:25.307168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:25.307168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:25.307525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:25.412449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:25.423038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:25.425193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:25.597817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 617/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:06:25.611485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:25.643953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:25.734979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b006190-cba4-492c-b9c7-5dee8b46d530 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:25.786988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:25.788625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:25.789196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:25.789620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:25.805074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:25.806800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:25.823494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:25.825666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:25.827813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:25.827813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:25.827813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:25.827813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 625/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:25.833070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:25.998621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:26.009124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61f8c-40ec-4407-ad8e-9f9453ccc960 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:26.066246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:26.067084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:26.067483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:26.067801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:26.068762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:26.069714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:26.071697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:26.092587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 618/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:26.102451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:26.222711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:26.254767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b37e4-f2d2-4e80-aa42-c683c1ddaf93 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:26.316829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:26.317835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:26.318333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:26.319367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:26.328610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:26.330405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:26.348926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:26.350425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:26.352740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 626/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:26.361763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:26.544770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33ad2-2035-4560-be8e-0470d79b85c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:26.617597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:26.618582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:26.619020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:26.619442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:26.620971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:26.621519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:26.624522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a109ef-7119-49bc-a480-c9dcd87d04f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:26.650618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 619/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:26.658332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:26.817159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3515b-cd85-407d-a9a5-1f46bf75ea94 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:26.864061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:26.864761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:26.865096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:26.865454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:26.867193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] RBAC: Adding query filter params (role.id=b5c6d777c01e412fadb11c5cefc4bbd2, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7e4b73d8301942e09c8430d3529ab769) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:26.867694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:26.869544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c5b7-2766-43fc-a971-a8740c17c9fa None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:26.877953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 627/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:26 2022] GET /identity/v3/role_assignments?user.id=7e4b73d8301942e09c8430d3529ab769&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=b5c6d777c01e412fadb11c5cefc4bbd2 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:29.478209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8132-7e4e-4aa8-a407-d6b858e0147d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:29.478780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8132-7e4e-4aa8-a407-d6b858e0147d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:29.478780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8132-7e4e-4aa8-a407-d6b858e0147d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:29.480342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 620/1247] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:29.491368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:29.492140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:29.492677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:29.504909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:29.523643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:29.525119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:29.629689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 628/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:29.931302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e8132-7e4e-4aa8-a407-d6b858e0147d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:29.957917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:30.097747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e8132-7e4e-4aa8-a407-d6b858e0147d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:30.147271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:30.148002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:30.148280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:30.148528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:30.165985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:30.167969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:30.169216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:30.170123 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 621/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:30.180996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:30.325372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccfd95-9a2f-4aad-9090-e3356b96ce20 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:30.361993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:30.369726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:30.370485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:30.370800 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:30.371140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:30.371915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:30.372256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:30.373643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:30.384030 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 629/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:30.390490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:30.504652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:30.532542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff9a5-e581-4d32-a82c-ca96798fd80a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:30.574851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:30.575545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:30.575767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:30.576073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:30.588333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:30.589804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:30.606308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:30.607698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:30.608743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:30.608743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:30.608743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:30.608743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 622/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:30.613968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:30.749852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472430ac-f8ec-404d-877d-eeb0b34837c7 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:30.786023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:30.786636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:30.786907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:30.787192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:30.787853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:30.788181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:30.789559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:30.803298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 630/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:30.809933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:30.947996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b27d-0ce6-45b1-bba9-77a0c42b74d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:30.985027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:30.995558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:30.996236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:30.996514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:30.996781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:31.008119 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:31.009863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:31.024486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:31.025601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:31.027449 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 623/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:31.033498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:31.127143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:31.184059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8355-3f1d-497c-99d3-a6b838db18f2 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:31.236452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:31.237394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:31.237872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:31.238333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:31.239625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:31.240176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:31.243406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:31.272050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 631/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:31.279409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:31.402940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13e2e4-282c-40cb-894a-97c7a8fa9bfc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:31.454368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:31.455389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:31.455884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:31.456404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:31.539850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:31.562283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:31.564391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:31.722920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 624/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:31.730389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:31.848446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2fff-420d-4a9b-9c26-ab41abe566de None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:31.864151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:31.894567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:31.895738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:31.896335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:31.897403 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:31.917362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:31.920569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:31.943822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:31.945454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:31.946836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:31.946836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:31.946836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:31.947261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 632/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:31.955315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:32.091917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:32.113014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2508-c71f-4c54-9214-5b5c3bb6936d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:32.164641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:32.165535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:32.165962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:32.166257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:32.166997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:32.167302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:32.169482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:32.187772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 625/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:32.195190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:32.326963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974f13-5ee9-4a36-a66a-2050a1cdd170 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:32.369230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:32.369766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:32.370040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:32.370314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:32.378282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:32.379864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:32.401441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:32.403425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:32.405222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 633/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:32.410595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:32.565617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636460-a5e2-4cc8-ab0a-f98099f2b526 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:32.607612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62870b05-c226-4650-baec-783f88398446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:32.608876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62870b05-c226-4650-baec-783f88398446 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:32.609441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62870b05-c226-4650-baec-783f88398446 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:32.609876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62870b05-c226-4650-baec-783f88398446 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:32.611087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62870b05-c226-4650-baec-783f88398446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:32.611630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62870b05-c226-4650-baec-783f88398446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:32.614232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62870b05-c226-4650-baec-783f88398446 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:32.644084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 626/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:32.651604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:32.690834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:32.784319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bed4ea-2e9d-4ed0-ae32-53d3c9b4bca8 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:32.839207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:32.840249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:32.840680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:32.840964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:32.842025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7e4b73d8301942e09c8430d3529ab769) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:32.842254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:32.844133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6f7c-73b1-4877-9f89-0ef1109ca014 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:32.864063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 634/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:32 2022] GET /identity/v3/role_assignments?user.id=7e4b73d8301942e09c8430d3529ab769&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:35.088422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25526-35f1-4351-a95f-7d58a81a52f9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:35.089003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25526-35f1-4351-a95f-7d58a81a52f9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:35.090495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25526-35f1-4351-a95f-7d58a81a52f9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:35.091899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 627/1261] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:35.100398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:35.100913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:35.100913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:35.121183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:35.122405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:35.192628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 635/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:35.467906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25526-35f1-4351-a95f-7d58a81a52f9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:35.479829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:35.590201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25526-35f1-4351-a95f-7d58a81a52f9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:35.634195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:35.634830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:35.635107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:35.635383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:35.647148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:35.652055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:35.653173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:35.654137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 628/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:35.660323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:35.682729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:35.780466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2763-3095-4a5b-8096-24760f7c518b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:35.817413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:35.818561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:35.818869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:35.819137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:35.819887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:35.820247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:35.821718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:35.831245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 636/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:35.838602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:35.923719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:35.961828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c473-d8df-4b18-bfe4-ecf699b9aa4d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:35.998219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:35.998848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:35.999122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:35.999387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.013225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.014675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:36.030438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:36.031827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:36.032813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:36.032813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:36.032813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:36.032813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 629/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:36.040998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.127174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:36.148096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287d281-1637-4e3b-bcfe-c95285af66de None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:36.185677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:36.186301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:36.186653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:36.186925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.187588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:36.187890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.189310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.203567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 637/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:36.209628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.321125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52ffd-cfd7-46bb-be23-efb6ed7bc2c3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:36.341480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:36.355930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:36.356636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:36.356866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:36.357130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.365927 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.367359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:36.379326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:36.381174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:36.382250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 630/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:36.388282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.497026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e333b-3c65-419f-906e-a0f4a6ce4dc4 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:36.545592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:36.546267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:36.546631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:36.546946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.547610 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:36.547997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.549544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.560241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:36.571035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 638/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:36.581074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.701668 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc1ab-f552-4c81-b8c5-d1c83ef2a37d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:36.747455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:36.748106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:36.748381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:36.748651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.760087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.761541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:36.777063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:36.778277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:36.779367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:36.779367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:36.779367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:36.779367 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 631/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:36.786025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.889879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c786-202b-41fb-b15f-34d745e72c0c None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:36.931397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:36.932062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:36.932346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:36.932615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:36.933272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:36.933570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:36.934938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:36.947636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 639/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:36.953699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:36.989967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:37.070138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3fd53-45d7-4251-b43c-1118201ae284 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:37.108990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:37.109624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.109905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.110178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.118207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:37.119785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:37.132488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:37.134171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:37.135896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 632/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:37.140143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:37.224038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:37.274007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4139c-5bfb-4786-b94d-970f9738ed37 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:37.315914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:37.316597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.316877 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.317152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.317883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:37.318731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:37.320246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a25c1-780f-469f-ae27-0d7fdd9aeb77 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:37.335457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 640/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:37.341840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:37.437991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:37.448592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db275f5-813c-47dc-95e5-fc12f3bb85d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:37.483304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:37.483985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.484270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.484544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] PATH_INFO: `/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7e4b73d8301942e09c8430d3529ab769/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.486560 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d87589c9b4f61b638b32f5427ac61, user_id=7e4b73d8301942e09c8430d3529ab769, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:37.488020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7235e16-d7ea-46ea-8202-9817f00c8f57 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:37.503526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 633/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 12:06:37 2022] PUT /identity/v3/projects/2f8d87589c9b4f61b638b32f5427ac61/users/7e4b73d8301942e09c8430d3529ab769/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:06:39.701187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ff6d-85d0-4eab-8b82-d880d1671069 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.701768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ff6d-85d0-4eab-8b82-d880d1671069 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.701768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ff6d-85d0-4eab-8b82-d880d1671069 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.703233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 641/1274] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:06:39.710265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.710816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.710816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.730583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:39.731830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:39.808945 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 634/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:40.086988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5ff6d-85d0-4eab-8b82-d880d1671069 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.226649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5ff6d-85d0-4eab-8b82-d880d1671069 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:40.258880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:40.285694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:40.286344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:40.286659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:40.286925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:40.299278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:40.304214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:40.305948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:40.307609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 642/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 12:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:40.313414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.403754 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:40.429452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973e77d-e695-47d1-8b6f-f5b9d540f16f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:40.467493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:40.468182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:40.468520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:40.468838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:40.469564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:40.469909 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:40.471370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:40.480780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 635/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 12:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:40.486874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.618107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571d6d-b8e2-4122-b96e-6d6f5996dcf1 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:40.656011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:40.656567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:40.656843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:40.657110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:40.669291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:40.670743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:40.687538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:40.689379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:40.691352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:40.691352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:40.691352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:40.691352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 643/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:40.696566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.820758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47148ed8-5ba5-489f-88d8-fa03962280b5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:40.855362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:40.855995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:40.856271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:40.856546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:40.857185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:40.857480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:40.858891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:40.872490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 636/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:40.878377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.911488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:40.993511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2644f-c4ec-48dc-ac74-8e0f8ecb3efe None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:41.031590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:41.032251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:41.032530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:41.032799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:41.041597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:41.043340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:41.056024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:41.057203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:41.058321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 644/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:41.063730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:41.067284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:41.175166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1adc-8fdb-4d14-b511-d7bdae28db4c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:41.210636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:41.211247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:41.211524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:41.211795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:41.212568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:41.212875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:41.214307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:41.234192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 637/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:41.240905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:41.333993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:41.344394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9b2c7-8887-4101-a8ea-9c7fb567d55d None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:41.379769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:41.380450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:41.380720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:41.380986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:41.460062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:41.461444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:41.571209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:41.584011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 645/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:41.590315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:41.659051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:41.703516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed60de-ccc9-4690-81f5-2182876364d4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:41.742555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:41.743112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:41.743392 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:41.743667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:41.755023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:41.757061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:41.774003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:41.775879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:41.777774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:41.777774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:41.777774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:41.777774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 638/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:41.781200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:41.888685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34005a-ee8a-4088-b372-6ecdf27bd1d9 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:41.927859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:41.928518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:41.928792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:41.929059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:41.929714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:41.930017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:41.931393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:41.944811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 646/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:41.950614 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:42.082402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe44b-bee5-447d-8f87-ddf069ce2fe7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:42.098228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:42.121162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:42.121811 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:42.122091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:42.122361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:42.131058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:42.132602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:42.145468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:42.147101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Sep 13 12:06:42.148755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 639/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:42.156146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:42.216906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:42.271037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbcad-b6d1-47f7-bc16-1fc56d149312 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:42.313866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:42.314487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:42.314765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:42.315034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:42.315738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:42.316256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:42.318410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a66e-c3d0-44ab-b9f5-faaf5e371076 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:42.332063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 647/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:42.338536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:42.446190 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b3cd1-f34b-450b-9c8e-28e1bce6cc8c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:42.485458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:42.486080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:42.486357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:42.486626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:42.487375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] RBAC: Adding query filter params (role.id=83fb245122344892b0377532854af000, scope.project.id=2f8d87589c9b4f61b638b32f5427ac61, user.id=7e4b73d8301942e09c8430d3529ab769) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:42.487678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:42.489173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6795-f27a-497a-92a7-2a12d495af22 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:42.496495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 640/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:42 2022] GET /identity/v3/role_assignments?user.id=7e4b73d8301942e09c8430d3529ab769&scope.project.id=2f8d87589c9b4f61b638b32f5427ac61&role.id=83fb245122344892b0377532854af000 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:44.815457 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2054-1330-4782-b501-e4687306ecc2 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.816037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2054-1330-4782-b501-e4687306ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.816128 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2054-1330-4782-b501-e4687306ecc2 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.818304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 648/1288] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:44.824148 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.824705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.824820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.845379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:44.846588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:44.887458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:44.928900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 641/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:06:45.204138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2054-1330-4782-b501-e4687306ecc2 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:45.319540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2054-1330-4782-b501-e4687306ecc2 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:45.330973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:45.355671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:45.356330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:45.356606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:45.356873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:45.357456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:45.358821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:45.369103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:45.370514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:45.371704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 649/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:06:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:45.376714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:45.486659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5d6bb-dd68-4ff2-9399-1e0dac94e80a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:45.528244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:45.529223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:45.529657 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:45.530075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:45.531089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:45.531619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:45.533335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a94d9-0442-4a3c-9460-4352595540bc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:45.539714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 642/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 12:06:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:45.548036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:45.678437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442d-8b8f-44a5-ae0d-be3f7b3de0ed None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:45.713178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:45.713784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:45.714061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:45.714329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] PATH_INFO: `/v3/services` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:45.714969 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:45.715265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:45.716654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3e527-2260-410e-b01b-b3f9c0668ec4 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:45.721718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 650/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 12:06:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:47.983065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1eec-8e57-4fde-944f-fbced613181b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:47.983718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1eec-8e57-4fde-944f-fbced613181b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:47.983718 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1eec-8e57-4fde-944f-fbced613181b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:47.985082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 643/1293] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:47.991434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed0398-655b-4625-b746-33a3f477c420 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:47.992006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed0398-655b-4625-b746-33a3f477c420 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:47.992006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed0398-655b-4625-b746-33a3f477c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.011233 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-56ed0398-655b-4625-b746-33a3f477c420 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:48.012492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-56ed0398-655b-4625-b746-33a3f477c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:48.046360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.089807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 651/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:48.361053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1eec-8e57-4fde-944f-fbced613181b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:48.399351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.476387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1eec-8e57-4fde-944f-fbced613181b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:48.512912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:48.513582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:48.513892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:48.514198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.514956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:48.516412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357f01e-b58f-47d5-8bbf-b8fe535c0641 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:48.532661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 644/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 12:06:48 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:06:50.737271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ff36-bd40-4b4f-a73d-b022a2654990 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.737867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ff36-bd40-4b4f-a73d-b022a2654990 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.737867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ff36-bd40-4b4f-a73d-b022a2654990 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.739193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 652/1296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:50.748949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.748949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.750411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.768708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:50.769959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:50.856124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 645/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:51.130354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34ff36-bd40-4b4f-a73d-b022a2654990 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:51.240875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34ff36-bd40-4b4f-a73d-b022a2654990 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:51.278524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:51.279155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:51.279430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:51.279692 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:51.280302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:51.281680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:51.290779 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:51.292311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:51.293183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 653/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:06:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:51.298997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:51.319952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:51.409191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3106dd-4985-4b9b-b42d-f38185427c77 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:51.446016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:51.446635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:51.446915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:51.447185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:51.447831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:51.448166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:51.449608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:51.455441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 646/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 12:06:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:51.463644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:51.496639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:51.576038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0fbd-7e8f-40c5-bdd5-65c9c9ad5666 None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:51.617795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:51.618411 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:51.618682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:51.618947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:51.619664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] RBAC: Adding query filter params (interface=public, service_id=5ce2a7d85d3249a8a383fe13b6d69121, region_id=RegionOne) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:51.619999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:51.621383 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb921e7-d93f-46b8-b396-c409de29298f None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:51.627087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 654/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 12:06:51 2022] GET /identity/v3/endpoints?service_id=5ce2a7d85d3249a8a383fe13b6d69121&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:51.633182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:51.719487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:51.739345 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba8c64-4cac-4641-b33c-73e89f36da79 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:51.774660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:51.775325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:51.775531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:51.775799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:51.776437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:51.777813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ba02-6487-4476-b5f3-a86e47958b9b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:51.786089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 647/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 12:06:51 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:06:54.028126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfc5-0252-49a2-adaf-40afd8ff4c27 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.028735 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfc5-0252-49a2-adaf-40afd8ff4c27 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.028886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfc5-0252-49a2-adaf-40afd8ff4c27 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.030469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 655/1302] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:54.037351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.037869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.037869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.056861 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:54.058066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:54.131995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 648/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:54.409722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0dfc5-0252-49a2-adaf-40afd8ff4c27 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.513675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.521889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0dfc5-0252-49a2-adaf-40afd8ff4c27 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.558790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.559424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.559702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.560006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] PATH_INFO: `/v3/services/placement` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.560606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.561970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:54.571409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:54.573343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: ERROR keystone.server.flask.application Sep 13 12:06:54.574824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 656/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:54.578919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.660801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.687801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41caf85-0e18-4252-8825-17ef35d5945f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.724801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.725421 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.725696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.725963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.726599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:54.726898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.728299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fe4f0-b46d-4b8e-9d08-2422e6b59c67 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.734172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 649/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:54.740458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.848646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67046568-d3bd-45e1-9a9d-75c16a9e03ea None admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.884809 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.885451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.885727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.885998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.886690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.888085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae943b53-15ef-41aa-ab28-8ab889d8c584 None admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.909385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 657/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:06:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:07:04.730829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=30 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:04.904755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:06.122156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4943-592a-4f57-ba45-44ae4c19c131 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:06.123283 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4943-592a-4f57-ba45-44ae4c19c131 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:06.123883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4943-592a-4f57-ba45-44ae4c19c131 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:06.125572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 650/1307] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:06.131770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314fdc-d2b5-426e-913b-bcf9d0a9b161 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:06.132353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314fdc-d2b5-426e-913b-bcf9d0a9b161 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:06.132353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314fdc-d2b5-426e-913b-bcf9d0a9b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:06.252443 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-29314fdc-d2b5-426e-913b-bcf9d0a9b161 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:06.254000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-29314fdc-d2b5-426e-913b-bcf9d0a9b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:06.394074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 658/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:06.694313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:06.695487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:06.696849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:06.702546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 651/1309] 10.222.0.43 () {54 vars in 965 bytes} [Tue Sep 13 12:08:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:06.708586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8dad0-1543-49e6-b210-46dc79924257 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:06.708953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8dad0-1543-49e6-b210-46dc79924257 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:06.709211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8dad0-1543-49e6-b210-46dc79924257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:06.825384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f5b8dad0-1543-49e6-b210-46dc79924257 None None] MFA Rules not processed for user `4003563bd8444eeea77159305220aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:06.827196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f5b8dad0-1543-49e6-b210-46dc79924257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:06.851737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:06.933894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:06.936537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:06.940843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 659/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Sep 13 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:08:07.116273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53899b-0479-44ed-93c0-6d58457c2961 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:07.222353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:07.223894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:07.224250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:07.224518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:07.226155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:07.301926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:07.409083 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:07.412197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75522288-4ca6-4068-aae5-60748af01a23 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:07.436289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 652/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:08:10.117813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:10.118436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:10.118751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:10.120719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 660/1312] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:10.130161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9171-af17-41c1-8bf8-4ca313e67bb0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:10.130707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9171-af17-41c1-8bf8-4ca313e67bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:10.130881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9171-af17-41c1-8bf8-4ca313e67bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:10.219312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-980d9171-af17-41c1-8bf8-4ca313e67bb0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:10.220671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-980d9171-af17-41c1-8bf8-4ca313e67bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:10.326506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 653/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:10.612875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:10.614437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:10.730388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe241bf-4f38-4712-895c-6d3997910308 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:10.808130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:10.811973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:10.813205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:10.813822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:10.814379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:10.816194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:10.934149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:10.936135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e6ec-d0ae-445d-b480-feffd09838c7 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:10.956241 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 661/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:13.564596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:13.565359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:13.565359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:13.566467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 654/1315] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:08:13.572795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff30-822f-4318-89a5-6709fce89d18 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:13.573290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff30-822f-4318-89a5-6709fce89d18 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:13.573384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff30-822f-4318-89a5-6709fce89d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:13.647091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3d65ff30-822f-4318-89a5-6709fce89d18 None None] MFA Rules not processed for user `383f739d01c541de80f80471834f5e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:13.648517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3d65ff30-822f-4318-89a5-6709fce89d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:13.704981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:13.757011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 662/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:08:14.043751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:14.045336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:14.055205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:14.156790 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7375-01b7-4fff-bb7b-07e42d86b6d0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:14.243707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:14.244375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:14.244642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:14.244905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:14.246494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:14.310641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:14.361224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:14.362675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d49fbf-fd5d-4bc0-9b24-4bc98e3d81bd service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:14.382386 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 655/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:17.168318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba388-03f8-4d76-b9ae-7d244c01a701 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:17.169036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba388-03f8-4d76-b9ae-7d244c01a701 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:17.169036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba388-03f8-4d76-b9ae-7d244c01a701 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:17.170160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 663/1318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:17.176122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b16b-29d1-41eb-a4e4-419b528c6e78 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:17.176672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b16b-29d1-41eb-a4e4-419b528c6e78 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:17.176869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b16b-29d1-41eb-a4e4-419b528c6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:17.255158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a961b16b-29d1-41eb-a4e4-419b528c6e78 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:17.256422 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a961b16b-29d1-41eb-a4e4-419b528c6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:17.372038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 656/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:17.686173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:17.686469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:17.686710 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:17.688098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 664/1320] 10.222.0.43 () {54 vars in 965 bytes} [Tue Sep 13 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:17.694638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b68e-104e-4340-be9e-e65f21ffd83f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:17.694915 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b68e-104e-4340-be9e-e65f21ffd83f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:17.695184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b68e-104e-4340-be9e-e65f21ffd83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:17.727101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:17.788908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6321b68e-104e-4340-be9e-e65f21ffd83f None None] MFA Rules not processed for user `4003563bd8444eeea77159305220aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:17.790053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6321b68e-104e-4340-be9e-e65f21ffd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:17.873404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 657/1321] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Sep 13 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:17.882766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:17.884325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:18.052451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc558-cb57-4aec-9371-851c5e8377ff None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:18.136230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:18.136859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:18.137136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:18.137408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:18.139151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:18.147700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:18.263589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:18.265086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b054a-9fa3-4ee7-b6ad-2d82454a0aef service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:18.284567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 665/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:08:21.848294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:21.849071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:21.849071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:21.850171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 658/1323] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:21.859067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeaab4-5240-4892-b06a-6f935883de71 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:21.859874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeaab4-5240-4892-b06a-6f935883de71 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:21.859874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeaab4-5240-4892-b06a-6f935883de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:21.960879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-5beeaab4-5240-4892-b06a-6f935883de71 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:21.962135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5beeaab4-5240-4892-b06a-6f935883de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:22.051672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:22.116543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 666/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:22.405067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:22.407872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:22.591004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce506-bc9b-4b5d-8c2d-8e6dd3c082a2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:22.607746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:22.698361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:22.698991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.699373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.699752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.701749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:22.855954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:22.857476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2151-373c-4edc-bf7e-75896f5b3fee service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:22.879625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 659/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:25.225606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:25.226175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:25.226175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:25.227408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 667/1326] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:25.234296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000c65-63b1-48d4-b207-73e8717e8ed5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:25.234830 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000c65-63b1-48d4-b207-73e8717e8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:25.235064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000c65-63b1-48d4-b207-73e8717e8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:25.309286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:25.330995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a6000c65-63b1-48d4-b207-73e8717e8ed5 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:25.340111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a6000c65-63b1-48d4-b207-73e8717e8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:25.470171 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 660/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:25.757654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:25.759488 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:25.913033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1af41-0a07-4b95-a469-14db30ce661f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:26.020961 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:26.021574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:26.021855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:26.022120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:26.023762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:26.043537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:26.183925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:26.185526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a7b7e-adf6-4756-8f73-dbdfaaea570b service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:26.207205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 668/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:28.568516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:28.569292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:28.569292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:28.570542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 661/1329] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:28.577098 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820ed5-6e0b-401c-adc2-2ee62a74083d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:28.577637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820ed5-6e0b-401c-adc2-2ee62a74083d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:28.577781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820ed5-6e0b-401c-adc2-2ee62a74083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:28.656849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-85820ed5-6e0b-401c-adc2-2ee62a74083d None None] MFA Rules not processed for user `383f739d01c541de80f80471834f5e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:28.658159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-85820ed5-6e0b-401c-adc2-2ee62a74083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:28.738725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:28.773791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 669/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:08:29.063628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:29.066604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:29.216567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10656e10-f067-453f-b6e2-7731b7dd26f5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:29.241481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:29.330468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:29.331338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:29.331743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:29.332187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:29.334769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:29.499586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:29.501611 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e64903-eb98-4249-b3b1-a82d26ec8205 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:29.524940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 662/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:32.133354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:32.133953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:32.133953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:32.135235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 670/1332] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:32.141328 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132517-e963-4077-b4b8-c638dc6d4252 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:32.141847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132517-e963-4077-b4b8-c638dc6d4252 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:32.141847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132517-e963-4077-b4b8-c638dc6d4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:32.216291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:32.219719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-40132517-e963-4077-b4b8-c638dc6d4252 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:32.221798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-40132517-e963-4077-b4b8-c638dc6d4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:32.339729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 663/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:32.624408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:32.625936 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:32.744530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599e3c5-511c-478b-a2f5-bfe89a0f2830 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:32.833923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:32.834702 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:32.835013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:32.835374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:32.837757 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:32.873175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:32.965660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:32.967087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a633-5f5a-4991-b1ab-a9f5492f1e6b service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:32.987327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 671/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:35.420262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:35.421151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:35.421151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:35.422110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 664/1335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:35.427891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a568ba-6393-4303-9e8c-9d18bf5469fc None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:35.428390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a568ba-6393-4303-9e8c-9d18bf5469fc None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:35.428501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a568ba-6393-4303-9e8c-9d18bf5469fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:35.500752 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a1a568ba-6393-4303-9e8c-9d18bf5469fc None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:35.501967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a1a568ba-6393-4303-9e8c-9d18bf5469fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:35.594929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:35.619555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 672/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:35.911514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:35.913296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:36.055163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b783e5-f84b-4651-8891-fd2172716ee7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:36.085918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:36.138504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:36.139124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:36.139398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:36.139663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:36.141361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:36.266461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:36.268017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b271-ca67-40d4-bbf1-5481bb95847f service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:36.289079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 665/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:38.950911 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:38.951460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:38.951460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:38.952823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 673/1338] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:38.958369 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026549-a6fb-45d1-ba28-049cbadc99da None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:38.958895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026549-a6fb-45d1-ba28-049cbadc99da None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:38.959001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026549-a6fb-45d1-ba28-049cbadc99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:39.038014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-22026549-a6fb-45d1-ba28-049cbadc99da None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:39.039253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-22026549-a6fb-45d1-ba28-049cbadc99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:39.049002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:39.159012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 666/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:39.444313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:39.445868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:39.568517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8bcf-c208-4870-9e6d-f0693bc4b902 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:39.696308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:39.697245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:39.697738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:39.698226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:39.701414 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:39.756257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:39.860873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:39.862347 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068448-cb32-4b59-9385-3695c849a1a4 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:39.883463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 674/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:08:44.817618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:44.818365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:44.818365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:44.820125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 667/1341] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:44.825932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3bc58-9ddc-4e48-ae83-1d1ed6cf9e8e None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:44.826493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3bc58-9ddc-4e48-ae83-1d1ed6cf9e8e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:44.826493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3bc58-9ddc-4e48-ae83-1d1ed6cf9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:44.905951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e9e3bc58-9ddc-4e48-ae83-1d1ed6cf9e8e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:44.907109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e9e3bc58-9ddc-4e48-ae83-1d1ed6cf9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:45.025162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:45.038988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 675/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:45.334704 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:45.336279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:45.539234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7d4c-c885-4174-80b3-a6e13ca682fd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:45.614740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:45.684355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:45.685374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:45.685852 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:45.686308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:45.692268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:45.892579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:45.894022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9ed5f-4f7d-47ad-8c99-3b56cfe6f20c service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:45.916785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 668/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:08:48.879172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:48.879765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:48.879765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:48.881075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 676/1344] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:48.886646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b74a0-8595-42b8-a19f-7a8f27b1b7ae None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:48.887172 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b74a0-8595-42b8-a19f-7a8f27b1b7ae None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:48.887351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b74a0-8595-42b8-a19f-7a8f27b1b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:48.966257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-242b74a0-8595-42b8-a19f-7a8f27b1b7ae None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:48.967464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-242b74a0-8595-42b8-a19f-7a8f27b1b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:48.987723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:49.082523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 669/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:08:49.372550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:49.374229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:49.500055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc668f5e-f94c-409a-a07c-cf5ed86f986d None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:49.590179 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:49.590793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:49.591068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:49.591332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:49.593034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:49.643408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:49.729512 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:49.731165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8dfea-1eca-49b1-9b70-4a4de2c3fd4a service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:49.757957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 677/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:54.435674 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:54.436321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:54.436321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:54.437597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 670/1347] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:54.443548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ec4d-787c-4926-93af-ec523c50a63a None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:54.444109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ec4d-787c-4926-93af-ec523c50a63a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:54.444200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ec4d-787c-4926-93af-ec523c50a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:54.523165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c395ec4d-787c-4926-93af-ec523c50a63a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:54.524475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c395ec4d-787c-4926-93af-ec523c50a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:54.652417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:54.660361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 678/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:54.958938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:54.960554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:55.078591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f13d-30bb-4db4-adc4-f7046e3978c6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:55.130069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:55.158529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:55.159138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:55.159676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:55.159941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:55.161566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:55.272815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:55.274805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7e276-ad02-4a40-b691-301de222265d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:55.294597 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 671/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:00.792721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2e72-ff52-42d0-a477-59841d008af5 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:00.793606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2e72-ff52-42d0-a477-59841d008af5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:00.793606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2e72-ff52-42d0-a477-59841d008af5 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:00.794917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 679/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:00.800898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa525-72f4-4134-9a2f-f541326a9a53 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:00.801687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa525-72f4-4134-9a2f-f541326a9a53 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:00.801687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa525-72f4-4134-9a2f-f541326a9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:00.923366 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-15daa525-72f4-4134-9a2f-f541326a9a53 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:00.927324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-15daa525-72f4-4134-9a2f-f541326a9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:00.975351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:01.106794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 672/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:06.057824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6668c-0ec3-4d33-b06e-fffb94e70d4c None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:06.058640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6668c-0ec3-4d33-b06e-fffb94e70d4c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:06.058640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6668c-0ec3-4d33-b06e-fffb94e70d4c None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:06.059978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 680/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:06.065758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b028c-377d-404a-a201-ad086dcbeeb5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:06.066358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b028c-377d-404a-a201-ad086dcbeeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:06.066484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b028c-377d-404a-a201-ad086dcbeeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:06.171804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-da3b028c-377d-404a-a201-ad086dcbeeb5 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:06.173214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-da3b028c-377d-404a-a201-ad086dcbeeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:06.266325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:06.313679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 673/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:08.019574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2b53-fcd2-4af8-8bb7-c7667c816c8e None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:08.019574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2b53-fcd2-4af8-8bb7-c7667c816c8e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:08.020671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2b53-fcd2-4af8-8bb7-c7667c816c8e None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:08.021596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 681/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:08.030308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4142026-fbaa-4d11-8cb8-2f6ae4936a0d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:08.031189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4142026-fbaa-4d11-8cb8-2f6ae4936a0d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:08.031351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4142026-fbaa-4d11-8cb8-2f6ae4936a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:08.160988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f4142026-fbaa-4d11-8cb8-2f6ae4936a0d None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:08.163258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f4142026-fbaa-4d11-8cb8-2f6ae4936a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:08.300844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 674/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:12.647484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97fe-628c-495b-9dfc-44cc2a2d2de3 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:12.648394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97fe-628c-495b-9dfc-44cc2a2d2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:12.649075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f97fe-628c-495b-9dfc-44cc2a2d2de3 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:12.650682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 682/1356] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:12.657121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1269-98a6-467f-8519-89a1ffd14033 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:12.657620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1269-98a6-467f-8519-89a1ffd14033 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:12.657724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1269-98a6-467f-8519-89a1ffd14033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:12.710672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:12.772314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a11e1269-98a6-467f-8519-89a1ffd14033 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:12.773816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a11e1269-98a6-467f-8519-89a1ffd14033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:12.966344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 675/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:13.452655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:13.453968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:13.454874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:13.459009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 683/1358] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 12:09:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:13.473745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab96a25-7df6-427f-8b89-a964f5741b47 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:13.475069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab96a25-7df6-427f-8b89-a964f5741b47 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:13.475926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab96a25-7df6-427f-8b89-a964f5741b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:13.603088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8ab96a25-7df6-427f-8b89-a964f5741b47 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:13.605785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8ab96a25-7df6-427f-8b89-a964f5741b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:13.709022 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:13.867053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 676/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:13.881115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:13.887857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:14.143865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e367-8a8c-4b92-8cd3-1af4bfcf91d4 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:14.279334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:14.341045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:14.341753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:14.342095 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:14.342432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:14.344164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:14.473839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:14.475489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c8b9-0889-44a8-86e7-b49c26d31c00 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:14.504815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 684/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:17.555399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:17.556353 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:17.556629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:17.558203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 677/1361] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:17.564538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a888c5-1943-47f0-a4f3-97ad2337748e None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:17.565360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a888c5-1943-47f0-a4f3-97ad2337748e None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:17.565360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a888c5-1943-47f0-a4f3-97ad2337748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:17.645027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a2a888c5-1943-47f0-a4f3-97ad2337748e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:17.646470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a2a888c5-1943-47f0-a4f3-97ad2337748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:17.704459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:17.810389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 685/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:18.132762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:18.134587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:18.369272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493789-21c9-49b3-aa6c-9f6740c092f5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:18.381598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:18.543803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:18.544574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:18.544976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:18.545153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:18.546712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:18.700955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:18.702905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6126be-762d-42d6-b783-f3248fd585b4 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:18.729107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 678/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:21.944917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22fa50-1427-4fb7-b7d9-f3693232cfcb None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:21.945907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22fa50-1427-4fb7-b7d9-f3693232cfcb None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:21.945907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22fa50-1427-4fb7-b7d9-f3693232cfcb None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:21.953784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167d12-a93a-43ac-be99-fd062d6242bd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:21.954655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167d12-a93a-43ac-be99-fd062d6242bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:21.954655 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167d12-a93a-43ac-be99-fd062d6242bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:21.958930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 686/1364] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:21.971912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:22.055354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f8167d12-a93a-43ac-be99-fd062d6242bd None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:22.056896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f8167d12-a93a-43ac-be99-fd062d6242bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:22.220115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 679/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:22.619729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bcaa-83b4-48e8-be76-d6a457b12589 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:22.620313 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bcaa-83b4-48e8-be76-d6a457b12589 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:22.620728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bcaa-83b4-48e8-be76-d6a457b12589 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:22.622749 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 687/1366] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:22.629341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:22.629789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:22.630201 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:22.725549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:22.727252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:22.743447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c594be-0a76-4328-aba1-484d83e236c3 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:22.743944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c594be-0a76-4328-aba1-484d83e236c3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:22.744469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c594be-0a76-4328-aba1-484d83e236c3 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:22.748114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 688/1367] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 12:09:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:22.756533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078884-479e-4666-8755-ea8fdca5916a None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:22.757299 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078884-479e-4666-8755-ea8fdca5916a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:22.758964 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078884-479e-4666-8755-ea8fdca5916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:22.789238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:22.871280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 680/1368] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:22.890343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-1a078884-479e-4666-8755-ea8fdca5916a None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:22.891946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-1a078884-479e-4666-8755-ea8fdca5916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.070019 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:23.118300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 689/1369] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:23.138240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:23.140736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.194770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478080-811e-4164-8e79-d6708e5241ea None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.195995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478080-811e-4164-8e79-d6708e5241ea None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.196536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478080-811e-4164-8e79-d6708e5241ea None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.199021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 690/1370] 10.222.0.43 () {54 vars in 964 bytes} [Tue Sep 13 12:09:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:23.208230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.208695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.209113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.350948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] MFA Rules not processed for user `6338b9fc256a401083017d59fc4ceff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:23.352697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.399385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a31835-9d86-4f4f-b816-d24baf9c50a2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:23.443899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 691/1371] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Sep 13 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:23.453088 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:23.462376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cc5e-089a-4a31-abe2-f5687bf94d16 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:23.510646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:23.600021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:23.602405 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6338b9fc256a401083017d59fc4ceff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:23.603124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72137-e451-4538-9426-327988016095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:23.603435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.604324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72137-e451-4538-9426-327988016095 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.604461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.604635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.604881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72137-e451-4538-9426-327988016095 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.605274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72137-e451-4538-9426-327988016095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.607069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.607725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-67e72137-e451-4538-9426-327988016095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.774461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72137-e451-4538-9426-327988016095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:23.777475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72137-e451-4538-9426-327988016095 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:23.810274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:23.811855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8fd16-839d-4c7a-bde6-889306848e5b service cinder] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:23.822102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 681/1372] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:23.848551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 692/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:26.386444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:26.387151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:26.387342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:26.390244 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 682/1374] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:26.399149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c272c6-435e-46db-81fd-aa79e15b732b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:26.399940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c272c6-435e-46db-81fd-aa79e15b732b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:26.399940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c272c6-435e-46db-81fd-aa79e15b732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:26.502758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-42c272c6-435e-46db-81fd-aa79e15b732b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:26.504076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-42c272c6-435e-46db-81fd-aa79e15b732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:26.589583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:26.660279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 693/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:26.970069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:26.972304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:27.070841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:27.171055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1c4e-b286-471d-8b6a-423aed8d8947 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:27.327715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:27.328401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:27.328687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:27.329031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:27.330799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:27.369519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:27.463079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:27.464882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57764b1d-9e16-4409-a71b-d418fe34d31e service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:27.486272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 683/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:29.811169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:29.811569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:29.811760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:29.813359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 694/1377] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:29.818823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d16b5-80de-4e5a-8d01-d6a8eacfc177 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:29.819321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d16b5-80de-4e5a-8d01-d6a8eacfc177 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:29.819399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d16b5-80de-4e5a-8d01-d6a8eacfc177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:29.895636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7a8d16b5-80de-4e5a-8d01-d6a8eacfc177 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:29.896868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7a8d16b5-80de-4e5a-8d01-d6a8eacfc177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:30.012385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 684/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:30.309164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:30.311320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:30.546525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b96fd3-e6e3-4596-b2ae-b3d00ae5cbe5 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:30.631130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:30.772910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:30.773706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:30.774219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:30.774626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:30.776476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:30.898770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:30.900726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093bb9c-94ab-48e7-8018-b3dfbb279618 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:30.927154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 695/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:33.663552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:33.665006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:33.665134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:33.667495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 685/1380] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:33.677232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dcacc-c931-42eb-9d92-1ff64934a85b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:33.680873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dcacc-c931-42eb-9d92-1ff64934a85b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:33.680873 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dcacc-c931-42eb-9d92-1ff64934a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:33.766375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:33.787470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3b2dcacc-c931-42eb-9d92-1ff64934a85b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:33.789652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3b2dcacc-c931-42eb-9d92-1ff64934a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:33.926533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 696/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:34.223146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:34.225025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:34.230664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:34.431570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31cd84-23c7-4021-968e-7f2539a50c2d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:34.559554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:34.612309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:34.613086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.613401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.613596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.615339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:34.757310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:34.761472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed123a-e9cf-4644-b5f1-948e187bcd9f service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:34.798916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 686/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:37.332543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:37.333363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:37.333363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:37.334425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 697/1383] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:37.341065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261c59-b2eb-43be-8f67-c21610cc5c4e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:37.341648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261c59-b2eb-43be-8f67-c21610cc5c4e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:37.341648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0261c59-b2eb-43be-8f67-c21610cc5c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:37.422896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d0261c59-b2eb-43be-8f67-c21610cc5c4e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:37.424358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d0261c59-b2eb-43be-8f67-c21610cc5c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:37.470747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:37.531329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 687/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:37.825029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:37.826574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:37.980747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:38.017895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d47a9-efd8-4ab5-a9d9-1cb53dca0740 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:38.186120 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:38.186751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:38.187024 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:38.187296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:38.189061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:38.290939 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:38.307814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:38.309860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964a064-edea-41b4-bb36-40c1df3749be service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:38.332300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 698/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:09:40.285872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550e3e-8565-4ca3-9866-2f889750d868 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.286525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550e3e-8565-4ca3-9866-2f889750d868 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.286828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550e3e-8565-4ca3-9866-2f889750d868 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.290431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 688/1386] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:40.300640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40eee4-3ce3-457b-b09b-3c97c910062d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.301409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40eee4-3ce3-457b-b09b-3c97c910062d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.301409 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40eee4-3ce3-457b-b09b-3c97c910062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.399452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ec40eee4-3ce3-457b-b09b-3c97c910062d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:40.405086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ec40eee4-3ce3-457b-b09b-3c97c910062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:40.544568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 699/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:40.627440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f7f52-54c4-4851-b142-1ab578c2e711 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.627922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f7f52-54c4-4851-b142-1ab578c2e711 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.628334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f7f52-54c4-4851-b142-1ab578c2e711 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.629817 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 689/1388] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:40.637374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.638105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.638476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.727490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:40.729516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:40.748593 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:40.851505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bf2f-a11f-4a58-be20-fa90eef6ef6b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.851783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bf2f-a11f-4a58-be20-fa90eef6ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.852082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bf2f-a11f-4a58-be20-fa90eef6ef6b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.853463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 690/1389] 10.222.0.43 () {54 vars in 966 bytes} [Tue Sep 13 12:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:40.859882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:40.860425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:40.860904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:40.863329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 700/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:40.952482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] MFA Rules not processed for user `7d4d52c9c7484014bef4a61bd9fd5ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:40.953697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:41.041706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 691/1391] 10.222.0.43 () {58 vars in 1063 bytes} [Tue Sep 13 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:41.053427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:41.057576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:41.174786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b297-4e6e-48fb-add0-73f19f514684 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:41.180238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:41.181428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:41.222522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:41.239725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:41.268340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4d52c9c7484014bef4a61bd9fd5ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:41.268953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:41.269224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:41.269489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:41.271183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:41.331853 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50b96-8907-4564-b607-185bf34cc2fb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:41.426198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:41.429070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ff84f-db3b-4129-9bf6-a6295b1f4ef6 service glance] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:41.461589 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:41.462157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:41.462428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:41.462685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:41.464351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:41.465165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 701/1392] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:41.501715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:41.583007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:41.587041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4839-3fd2-44a3-8b61-01288905f5b4 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:41.618825 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 692/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:09:42.336636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1ed3-3226-4a9f-9158-041d5ba09aa8 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.337503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1ed3-3226-4a9f-9158-041d5ba09aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.337503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1ed3-3226-4a9f-9158-041d5ba09aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.422541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-4d6f1ed3-3226-4a9f-9158-041d5ba09aa8 None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:42.423756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-4d6f1ed3-3226-4a9f-9158-041d5ba09aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:42.471803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:42.552581 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 702/1394] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:42.606288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.607006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.607176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.609240 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 693/1395] 10.222.0.43 () {54 vars in 943 bytes} [Tue Sep 13 12:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:42.616638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da6f6-8e88-4f01-81d1-abbba8b723a1 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.616947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da6f6-8e88-4f01-81d1-abbba8b723a1 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.617282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da6f6-8e88-4f01-81d1-abbba8b723a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.722703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-655da6f6-8e88-4f01-81d1-abbba8b723a1 None None] MFA Rules not processed for user `8f7865ffcaff4e8e8bdd7ceac7b27c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:42.724011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-655da6f6-8e88-4f01-81d1-abbba8b723a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:42.890791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 703/1396] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Sep 13 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:42.902606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:42.904476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:43.077039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc806cd-e59b-43b6-a387-d53c38c26963 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:43.098504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:43.206949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:43.207640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:43.208016 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:43.208400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:43.210077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:43.307910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:43.309568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46010ea7-1994-4ddd-9187-f616259b868b service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:43.318647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 694/1397] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 12:09:44.062308 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:44.062886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:44.062886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:44.084793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672ca2-a092-4979-a745-b763dc5f1c1f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:44.085700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672ca2-a092-4979-a745-b763dc5f1c1f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:44.086166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672ca2-a092-4979-a745-b763dc5f1c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:44.088564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 704/1398] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:44 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:44.236485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:44.241381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ed672ca2-a092-4979-a745-b763dc5f1c1f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:44.246398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ed672ca2-a092-4979-a745-b763dc5f1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:44.369775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 695/1399] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:44.667501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:44.669057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:44.678960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:44.846134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e269b-b3bf-44e6-9869-06fa26c8d2d0 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:44.945406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:44.994567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:44.995729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:44.996050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:44.996330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:44.998255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:45.124804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:45.126446 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2103-a407-403b-a23d-68b1cb343080 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:45.148474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 705/1400] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:47.655661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:47.656486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:47.656486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:47.657905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 696/1401] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:47.670039 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b467e-1daa-4cde-9861-67cbd1824cc6 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:47.670932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b467e-1daa-4cde-9861-67cbd1824cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:47.671078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b467e-1daa-4cde-9861-67cbd1824cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:47.777410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-861b467e-1daa-4cde-9861-67cbd1824cc6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:47.779094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-861b467e-1daa-4cde-9861-67cbd1824cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:47.844663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:47.945781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 706/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:48.257979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:48.260131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:48.617012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:48.648357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d2c9-b406-4547-a261-3a438ad94515 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:48.806858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:48.807931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:48.808196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:48.808562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:48.810332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:48.993255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:48.994902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ce25d-5f19-4c27-bcdf-3391e825319b service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:49.000175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:49.025506 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 697/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:51.607384 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.607891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.608011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.613516 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 707/1404] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:51.616500 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ab4f-42e6-4667-bd22-1f6019ed9068 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.617005 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ab4f-42e6-4667-bd22-1f6019ed9068 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.617418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ab4f-42e6-4667-bd22-1f6019ed9068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.737032 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d7b4ab4f-42e6-4667-bd22-1f6019ed9068 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:51.738262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d7b4ab4f-42e6-4667-bd22-1f6019ed9068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:51.880028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 698/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:52.169867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:52.171391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:52.391902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deb828-eeef-4265-97a4-67c0dbe67358 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:52.449001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:52.616001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:52.617335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:52.617782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:52.618203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:52.621080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:52.755189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:52.756746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed6b6f-f41b-4057-b4e0-36eea7ef96f3 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:52.783550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 708/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:55.105934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:55.106993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:55.106993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:55.108187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 699/1407] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:55.114771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f43-a7e1-4b18-8edb-04bdc10e5fc7 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:55.115398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f43-a7e1-4b18-8edb-04bdc10e5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:55.115398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f43-a7e1-4b18-8edb-04bdc10e5fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:55.167280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:55.210845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-d1f56f43-a7e1-4b18-8edb-04bdc10e5fc7 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:55.212326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d1f56f43-a7e1-4b18-8edb-04bdc10e5fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:55.365270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 709/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:55.663660 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:55.667187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:55.809055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:55.932650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd956aa-5c0f-45d8-a220-c0876321640f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:56.126017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:56.127100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:56.127100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:56.127397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:56.129059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:56.191285 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:56.351568 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:56.353238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415f3a-4167-41ba-9933-69f6e8a23f27 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:56.374617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 700/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:05.363199 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=51 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:06.372020 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=32 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:07.027445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aca92-fb52-4ab0-a2b7-11ac627a38ba None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.028043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aca92-fb52-4ab0-a2b7-11ac627a38ba None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.028043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aca92-fb52-4ab0-a2b7-11ac627a38ba None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.029364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 710/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Sep 13 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:07.035400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea519-ac01-4581-9d45-646014ce4800 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.035916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea519-ac01-4581-9d45-646014ce4800 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.036289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea519-ac01-4581-9d45-646014ce4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.141424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3f7ea519-ac01-4581-9d45-646014ce4800 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:07.142659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3f7ea519-ac01-4581-9d45-646014ce4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:07.278010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 701/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:07.293908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9287d1-773b-47cd-a64e-5bcc63879d3d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.294182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9287d1-773b-47cd-a64e-5bcc63879d3d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.294450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9287d1-773b-47cd-a64e-5bcc63879d3d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.295820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 711/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Sep 13 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:07.301402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f49d0-01b6-4533-9f38-0c053fa53cf3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.301712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f49d0-01b6-4533-9f38-0c053fa53cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.301994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f49d0-01b6-4533-9f38-0c053fa53cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.380114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:07.382882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-602f49d0-01b6-4533-9f38-0c053fa53cf3 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:07.384868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-602f49d0-01b6-4533-9f38-0c053fa53cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:07.513133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 702/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:10.206841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:10.207771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:10.207771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:10.208764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:10.215418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a1f4-4622-4fe2-b06f-04026085fa3c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:10.215985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a1f4-4622-4fe2-b06f-04026085fa3c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:10.215985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a1f4-4622-4fe2-b06f-04026085fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:10.311582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4292a1f4-4622-4fe2-b06f-04026085fa3c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:10.313407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4292a1f4-4622-4fe2-b06f-04026085fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:10.378812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:10.430184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:10.762138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:10.763708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:10.958980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271efeb-6740-43be-9138-0ae6d29b941f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:11.059430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:11.126228 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:11.126918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:11.127210 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:11.127567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:11.129600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:11.251798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:11.253458 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b66f9-28a0-4280-a3cd-727d1afed4d6 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:11.279824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 713/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:12.495640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:12.496213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:12.496213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:12.497466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:12.504146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c9c-9dc5-4501-9517-a423c608ad1c None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:12.504647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c9c-9dc5-4501-9517-a423c608ad1c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:12.504766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c9c-9dc5-4501-9517-a423c608ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:12.586539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-59b17c9c-9dc5-4501-9517-a423c608ad1c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:12.587753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-59b17c9c-9dc5-4501-9517-a423c608ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:12.621608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:12.702013 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:12.859025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:12.860564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:13.023417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46362ba8-6fff-4173-9455-a129bdba5422 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:13.067191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:13.143812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:13.144371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:13.144651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:13.144925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:13.146540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:13.246815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:13.248463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bdf43-9bdc-4519-870b-a0dd5908e693 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:13.267006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 705/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:14.434533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:14.435055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:14.435055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:14.436362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:14.442883 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f5be-5947-4d2a-ba34-76b371954e6a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:14.443393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f5be-5947-4d2a-ba34-76b371954e6a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:14.443513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f5be-5947-4d2a-ba34-76b371954e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:14.501454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:14.526040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9a50f5be-5947-4d2a-ba34-76b371954e6a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:14.528099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a50f5be-5947-4d2a-ba34-76b371954e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:14.633046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:14.791381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:14.793084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:14.948009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312eee2-c079-4d50-a8cd-1efaaa253c38 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:14.961370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:15.070653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:15.071264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:15.071539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:15.071802 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:15.073456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:15.175863 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:15.177494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e7c3-68de-4370-a137-df9df4390850 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:15.197162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 716/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:16.328034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:16.328680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:16.328680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:16.330431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:16.338737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d1e8-3ff6-4d0b-9a4c-343abad9f89a None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:16.339296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d1e8-3ff6-4d0b-9a4c-343abad9f89a None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:16.339296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d1e8-3ff6-4d0b-9a4c-343abad9f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:16.365728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:16.429075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-2524d1e8-3ff6-4d0b-9a4c-343abad9f89a None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:16.430189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-2524d1e8-3ff6-4d0b-9a4c-343abad9f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:16.532159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:10:16.682549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:16.684031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:16.807828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:16.849892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6c808-5533-4549-8265-e5af62ab8620 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:16.971882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:16.972444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:16.972725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:16.973001 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:16.974664 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:17.058275 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:17.073733 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:17.075397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799162d6-fd05-4b61-a9c5-d174d2c18d11 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:17.094344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 708/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:18.243879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:18.244476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:18.244476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:18.245795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:18.252489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417daee-dfe0-4cb1-a0ab-93d7caeff08e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:18.252999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417daee-dfe0-4cb1-a0ab-93d7caeff08e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:18.253109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417daee-dfe0-4cb1-a0ab-93d7caeff08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:18.343913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4417daee-dfe0-4cb1-a0ab-93d7caeff08e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:18.345208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4417daee-dfe0-4cb1-a0ab-93d7caeff08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:18.448235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:18.598933 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:18.601138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:18.692437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:18.770463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7180-b34e-4e8f-875d-d6c01e1622f3 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:18.891211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:18.891841 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:18.892152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:18.892430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:18.894113 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:18.947320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:18.992833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:18.994462 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf7ba-69c7-4245-8a1f-074ca53ce173 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:19.014035 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 719/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:20.113651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:20.114205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:20.114205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:20.116110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:20.124819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2ae6-a80a-4705-a954-e10260b25b75 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:20.125505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2ae6-a80a-4705-a954-e10260b25b75 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:20.125505 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2ae6-a80a-4705-a954-e10260b25b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:20.208934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-053c2ae6-a80a-4705-a954-e10260b25b75 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:20.210310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-053c2ae6-a80a-4705-a954-e10260b25b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:20.320026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:20.472948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:20.475542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:20.537823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:20.640234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2695b-4046-4c60-a554-e2fe4e2de7f8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:20.766262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:20.766788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:20.767064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:20.767339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:20.768986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:20.776910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:20.868343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:20.869937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d8aa5-9ac2-4774-a496-dc1bf0a7480a service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:20.888579 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 711/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:21.993255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:21.993810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:21.993810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:21.995289 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:22.002278 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57a76-d705-4342-abc0-16c73e7541fa None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:22.002822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57a76-d705-4342-abc0-16c73e7541fa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:22.002822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57a76-d705-4342-abc0-16c73e7541fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:22.086995 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9bf57a76-d705-4342-abc0-16c73e7541fa None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:22.088242 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9bf57a76-d705-4342-abc0-16c73e7541fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:22.160489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:22.197454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:22.355002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:22.356531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:22.375649 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:22.513741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d30a30-06e5-4513-949a-13f9ced7fb81 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:22.619723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:22.647803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:22.648504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:22.648782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:22.649052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:22.650663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:22.750585 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:22.752219 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497af26-cac4-47d3-99ff-b0923add0d9d service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:22.773216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 722/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:23.875207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:23.875758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:23.875758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:23.877028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:23.885563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe1d3-d60b-4fac-a496-b72dc6b235b4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:23.886103 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe1d3-d60b-4fac-a496-b72dc6b235b4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:23.886508 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe1d3-d60b-4fac-a496-b72dc6b235b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:23.980092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-065fe1d3-d60b-4fac-a496-b72dc6b235b4 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:23.981336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-065fe1d3-d60b-4fac-a496-b72dc6b235b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:24.029584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:24.088468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:24.245135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:24.246795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:24.406868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3a2a-6271-4c93-bad3-f9a640a97573 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:24.466921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:24.538036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:24.538648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:24.538925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:24.539193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:24.540886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:24.644041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:24.645694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d69cc-3d54-4d95-927d-3415314d9098 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:24.668057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 714/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:25.802255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:25.803497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:25.803497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:25.804906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:25.813158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9807-202c-41aa-978e-027f885e809e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:25.813774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9807-202c-41aa-978e-027f885e809e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:25.814086 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9807-202c-41aa-978e-027f885e809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:25.943346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fa4c9807-202c-41aa-978e-027f885e809e None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:25.944539 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fa4c9807-202c-41aa-978e-027f885e809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:25.946680 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:26.045396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:26.195371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:26.196847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:26.372192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098cef-f49c-48ce-8df3-2515ff208385 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:26.400899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:26.489890 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:26.490426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:26.490719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:26.490986 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:26.492670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:26.586843 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:26.588476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23b25-0cdb-4749-ade2-9f67d107bc14 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:26.607200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 725/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:28.754824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:28.755412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:28.755412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:28.756758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:28.762613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb816e-9da2-4add-8d23-4a220530f213 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:28.763155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb816e-9da2-4add-8d23-4a220530f213 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:28.763155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb816e-9da2-4add-8d23-4a220530f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:28.807895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:28.836151 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-8acb816e-9da2-4add-8d23-4a220530f213 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:28.837388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-8acb816e-9da2-4add-8d23-4a220530f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:28.944850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:29.231343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:29.232993 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:29.349012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1fc1d-88c7-4adc-9a3a-dadd9635c8d9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:29.382642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:29.425783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:29.426301 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:29.426573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:29.426839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:29.428497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:29.541450 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:29.543393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45495c2-a210-4b40-aa66-8682d2e230ef service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:29.568761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 717/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:31.985180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:31.985712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:31.985712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:31.987012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:31.993118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ac29-e80c-4b84-8384-b0da820029aa None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:31.993650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ac29-e80c-4b84-8384-b0da820029aa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:31.993650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ac29-e80c-4b84-8384-b0da820029aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:32.073826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cf69ac29-e80c-4b84-8384-b0da820029aa None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:32.075050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf69ac29-e80c-4b84-8384-b0da820029aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:32.088891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:32.202976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:32.497368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:32.499573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:32.618287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774db1fc-0dda-43a5-aa80-1e598b3b66c3 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:32.633358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:32.706140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:32.706840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:32.707109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:32.707372 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:32.709699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:32.838209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:32.840819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e244d-cdcb-4a97-a6bc-d33674453072 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:32.875901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 728/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:10:35.519792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:35.520382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:35.520382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:35.521669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:35.527682 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6d8-44e5-46aa-a18d-c6f43efab7ee None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:35.528262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6d8-44e5-46aa-a18d-c6f43efab7ee None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:35.528362 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6d8-44e5-46aa-a18d-c6f43efab7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:35.581893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:35.608451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e02be6d8-44e5-46aa-a18d-c6f43efab7ee None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:35.609716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e02be6d8-44e5-46aa-a18d-c6f43efab7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:35.719184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:36.008717 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:36.010324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:36.124376 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87ccd-bdee-47ce-b9ed-df2f747d4b5f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:36.174620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:36.215486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:36.216152 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:36.216412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:36.216703 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:36.218455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:36.347073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:36.348627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2cc2e-fa1f-444b-8ad7-26b028a678db service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:36.373173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 720/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:38.839663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:38.840296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:38.840296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:38.841569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:38.847197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdae2-5160-4e41-8170-5495db3dd559 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:38.847630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdae2-5160-4e41-8170-5495db3dd559 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:38.847787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdae2-5160-4e41-8170-5495db3dd559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:38.917208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-caefdae2-5160-4e41-8170-5495db3dd559 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:38.918442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-caefdae2-5160-4e41-8170-5495db3dd559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:38.939147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:39.019474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:39.325683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:39.328466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:39.445967 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4237-d46c-45b9-8b78-5915c4d38842 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:39.473713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:39.532408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:39.533045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:39.533319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:39.533586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:39.535501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:39.656365 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:39.657818 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a898dd-965a-4161-b3ea-aad7ac018c9e service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:39.677955 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 731/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:41.940271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:41.940814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:41.940814 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:41.943081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:41.952092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65777-f04c-4daa-919f-71d3d227f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:41.952678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65777-f04c-4daa-919f-71d3d227f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:41.952678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65777-f04c-4daa-919f-71d3d227f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:42.022445 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:42.025946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-23a65777-f04c-4daa-919f-71d3d227f7f6 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:42.027665 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-23a65777-f04c-4daa-919f-71d3d227f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:42.138052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:42.423532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:42.425187 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:42.530778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe6604-e914-463b-8788-89e576689c53 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:42.581252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:42.610612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:42.611229 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:42.611503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:42.611772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:42.613434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:42.732131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:42.733490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327b85d-8cad-46fc-9bc3-bc5f33f07b9c service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:42.752994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 723/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:45.025026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:45.025638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:45.025638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:45.026925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:45.032787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced77b-6807-4460-b354-ff139e152599 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:45.033263 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced77b-6807-4460-b354-ff139e152599 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:45.033387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced77b-6807-4460-b354-ff139e152599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:45.103970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4aced77b-6807-4460-b354-ff139e152599 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:45.105209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4aced77b-6807-4460-b354-ff139e152599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:45.137218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:45.213820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:45.499159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:45.500719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:45.619840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad17b-7ad0-43ab-9026-6ff74c8d4a01 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:45.650850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:45.697878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:45.698489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:45.698772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:45.699043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:45.700684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:45.815831 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:45.817999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa4d07-8711-487f-83ca-b11fe0bf9f47 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:45.836486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 734/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:48.140847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:48.141459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:48.141459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:48.142837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:48.150053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd270-0118-448a-b5a5-e0d1b0d34738 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:48.150999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd270-0118-448a-b5a5-e0d1b0d34738 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:48.150999 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd270-0118-448a-b5a5-e0d1b0d34738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:48.232903 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b37fd270-0118-448a-b5a5-e0d1b0d34738 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:48.234180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b37fd270-0118-448a-b5a5-e0d1b0d34738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:48.243956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:48.341440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:48.631256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:48.632820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:48.742094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4bc58-ee55-4b96-bfc0-ec6239085231 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:48.803451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:48.823765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:48.824481 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:48.824756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:48.825025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:48.826677 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:48.940320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:48.941708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ba90-4549-4b76-839e-67a71a81db6d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:48.968052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 726/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:51.273473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:51.274040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:51.274423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:51.276983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:51.286087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e73b-5ce7-4850-aece-4681e283cfdc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:51.286600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e73b-5ce7-4850-aece-4681e283cfdc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:51.286600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e73b-5ce7-4850-aece-4681e283cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:51.362716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2454e73b-5ce7-4850-aece-4681e283cfdc None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:51.364573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2454e73b-5ce7-4850-aece-4681e283cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:51.409090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:51.475875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:51.771447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:51.773089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:52.027522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0dfd7-341c-439f-bf9a-b908874e8312 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:52.078027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:52.125772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:52.126624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:52.126928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:52.127198 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:52.129524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:52.294678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:52.296059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf039b9-9eb8-42c6-a627-bbf7e21b1d4c service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:52.318546 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 737/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:54.578651 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:54.579181 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:54.579323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:54.580621 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:54.586441 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a1a5-a6fc-4748-bb75-2d203beaee63 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:54.586859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a1a5-a6fc-4748-bb75-2d203beaee63 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:54.586973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a1a5-a6fc-4748-bb75-2d203beaee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:54.659542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e5d8a1a5-a6fc-4748-bb75-2d203beaee63 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:54.661412 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e5d8a1a5-a6fc-4748-bb75-2d203beaee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:54.679923 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:54.762849 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:55.053156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:55.054690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:55.162037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b7c94-e195-4c8c-9d2f-da3830cad652 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:55.229357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:55.236548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:55.237155 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:55.237432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:55.237698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:55.239820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:55.347606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:55.349061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c1a9-3b04-4d6f-a98a-0c3c182441c8 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:55.367781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 729/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:57.539656 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:57.540456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:57.540456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:57.541820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:57.547678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e828-2793-4ccd-88eb-ca88dce7c590 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:57.548176 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e828-2793-4ccd-88eb-ca88dce7c590 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:57.548279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e828-2793-4ccd-88eb-ca88dce7c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:57.616370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5112e828-2793-4ccd-88eb-ca88dce7c590 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:57.617565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5112e828-2793-4ccd-88eb-ca88dce7c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:57.665965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:57.715266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:57.997339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:57.998872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:58.101987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1f743-d53d-4c3e-8d23-71238d78baac None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:58.150652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:58.177894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:58.178501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:58.178777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:58.179046 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:58.180659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:58.291254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:58.292627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d7e09-447e-4168-ab2a-06a8f68a2151 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:58.310879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 740/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:07.713686 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=22 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:08.308605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=66 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:19.096483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dbdc-b619-433c-b44d-527c9c6157ec None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:19.097043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dbdc-b619-433c-b44d-527c9c6157ec None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:19.097043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dbdc-b619-433c-b44d-527c9c6157ec None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:19.098406 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 731/1471] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:19.103823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2bc2-e8d9-4d8b-973c-3ce65713d94d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:19.104274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2bc2-e8d9-4d8b-973c-3ce65713d94d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:19.104381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2bc2-e8d9-4d8b-973c-3ce65713d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:19.173515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-675d2bc2-e8d9-4d8b-973c-3ce65713d94d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:19.174764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-675d2bc2-e8d9-4d8b-973c-3ce65713d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:19.272482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 741/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:11:19.572078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:19.572364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:19.572636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:19.573987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 732/1473] 10.222.0.43 () {54 vars in 966 bytes} [Tue Sep 13 12:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:19.579054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd90b-cba9-446e-98d5-5f71d5998f02 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:19.579339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd90b-cba9-446e-98d5-5f71d5998f02 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:19.579606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd90b-cba9-446e-98d5-5f71d5998f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:19.657142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c1bfd90b-cba9-446e-98d5-5f71d5998f02 None None] MFA Rules not processed for user `7d4d52c9c7484014bef4a61bd9fd5ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:19.658605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c1bfd90b-cba9-446e-98d5-5f71d5998f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:19.680382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:19.735302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 742/1474] 10.222.0.43 () {58 vars in 1063 bytes} [Tue Sep 13 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:19.743808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:19.745359 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:19.849738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e380128-f843-4ef7-94ed-2ff6d4576cef None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:19.923321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4d52c9c7484014bef4a61bd9fd5ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:19.923920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:19.924227 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:19.924513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:19.926719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:19.981264 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:20.038105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:20.039531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b08e5-9404-4704-95b0-1f15ae2d6f4a service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:20.058101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 733/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:22.330784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.331856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.331856 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.333249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 743/1476] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:22.338745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992a5a-0f46-4b7d-b496-613ccaa909c7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.339160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992a5a-0f46-4b7d-b496-613ccaa909c7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.339294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992a5a-0f46-4b7d-b496-613ccaa909c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.406143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ec992a5a-0f46-4b7d-b496-613ccaa909c7 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:22.407336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ec992a5a-0f46-4b7d-b496-613ccaa909c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:22.511842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 734/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:22.791949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:22.793410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:22.920127 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7d716-8c24-4f2b-ab04-6dd8f996832b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:22.970566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:23.019784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:23.020426 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:23.020701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:23.020968 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:23.021612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:23.023374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:11:23.023374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:11:23.023374 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:11:23.024530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3637-75e5-4a27-adce-669cf425e6f7 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:23.045647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 744/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 12:11:22 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:11:25.323302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:25.323837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:25.323837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:25.325223 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 735/1479] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:25.330699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b0b8-de86-4286-9231-c295330be9c9 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:25.331744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b0b8-de86-4286-9231-c295330be9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:25.331744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b0b8-de86-4286-9231-c295330be9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:25.398043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-b8b7b0b8-de86-4286-9231-c295330be9c9 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:25.399267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-b8b7b0b8-de86-4286-9231-c295330be9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:25.499530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 745/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:25.802959 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:25.805230 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:25.817620 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:26.074528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd85d-71e8-4a68-ab5b-557ba907e37b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:26.162142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:26.195952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:26.196586 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:26.196864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:26.197134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:26.198719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:26.287080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:26.288689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2c5e-c0d5-4073-8da1-08e12bee82be service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:26.307025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 736/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:28.671577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:28.672209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:28.672209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:28.673491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 746/1482] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:28.679378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729ca5-ca99-444b-a130-5f6577ed6362 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:28.679834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729ca5-ca99-444b-a130-5f6577ed6362 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:28.680109 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729ca5-ca99-444b-a130-5f6577ed6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:28.747467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ba729ca5-ca99-444b-a130-5f6577ed6362 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:28.748715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ba729ca5-ca99-444b-a130-5f6577ed6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:28.795798 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:28.848296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 737/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:29.135258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:29.136801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:29.160778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:29.249038 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fddf1-0d6d-4f33-8110-ac5130ca6205 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:29.322770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:29.323370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:29.323644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:29.323906 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:29.325497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:29.401023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:29.436511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:29.437931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541701-0913-44a2-8d21-196119d1d688 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:29.455858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 747/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:31.711142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:31.711699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:31.711699 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:31.713101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 738/1485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:31.719034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53587-5917-48e2-8430-46d2a2a3f5c4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:31.719493 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53587-5917-48e2-8430-46d2a2a3f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:31.719594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53587-5917-48e2-8430-46d2a2a3f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:31.786948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-13a53587-5917-48e2-8430-46d2a2a3f5c4 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:31.788191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-13a53587-5917-48e2-8430-46d2a2a3f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:31.889854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 748/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:32.179940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:32.181543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:32.286960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9315810-bb87-4340-bdbd-c3594f52407e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:32.359436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:32.360971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:32.361582 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:32.362055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:32.362373 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:32.364322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:32.472215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:32.473644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d11e8-5bc9-4a14-b622-307845e50cc2 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:32.491268 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 739/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:34.815050 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:34.815603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:34.815603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:34.816990 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 749/1488] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:34.822549 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351b32-9c63-4e6a-a991-dba6dd8467fe None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:34.823028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351b32-9c63-4e6a-a991-dba6dd8467fe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:34.823130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351b32-9c63-4e6a-a991-dba6dd8467fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:34.889014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c8351b32-9c63-4e6a-a991-dba6dd8467fe None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:34.890218 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c8351b32-9c63-4e6a-a991-dba6dd8467fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:34.944775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:34.990872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 740/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:35.292879 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:35.294479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:35.332066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:35.398258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf37dd-aad7-4c8f-a32b-8f2cca81a65d None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:35.472257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:35.472782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:35.473057 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:35.473325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:35.474902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:35.555342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:35.584648 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:35.586074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acd1d1-0ddd-485b-a2c6-52e4c2cb572e service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:35.604673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 750/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:38.003144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:38.003695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:38.003695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:38.004981 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 741/1491] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 12:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:38.010298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645ca1-6ddf-4056-95cb-c283620c8b5d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:38.010744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645ca1-6ddf-4056-95cb-c283620c8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:38.010846 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645ca1-6ddf-4056-95cb-c283620c8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:38.077339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-fb645ca1-6ddf-4056-95cb-c283620c8b5d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:38.078561 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-fb645ca1-6ddf-4056-95cb-c283620c8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:38.183073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 751/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:38.469627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:38.471684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:38.577467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14f20-5a65-4cff-908a-ecf0ab75413d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:38.651538 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:38.652168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:38.652442 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:38.652715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:38.654304 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:38.663780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:38.763510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:38.765010 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb300-6a7c-4ccd-889f-69aadbedb0c9 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:38.784407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 742/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:48.181545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=82 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:48.781191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=50 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:12:59.133918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.134630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.134630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.218836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:12:59.220078 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.323615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 752/1494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:12:59.332661 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.333250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.333250 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.427760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:12:59.429415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.539775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 743/1495] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:12:59.544606 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.545791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.557627 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d025a-8853-48ad-aa4f-329a7661f352 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:12:59.622812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:12:59.671361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:12:59.674497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.674820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.675092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.675763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:12:59.677207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:12:59.678351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:12:59.678351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:12:59.678351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:12:59.679225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:12:59.699731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 753/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:12:59.708074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.718225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abbc66-4dcc-438e-afe3-6b3f71b51c76 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:12:59.783311 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:12:59.818795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:12:59.819559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.819687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.819982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.820609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:12:59.822389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:12:59.822389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:12:59.822389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:12:59.823569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:12:59.883273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 744/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:12:59.888251 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.889794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.925950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c7fad-a772-4d90-9fd7-9aef6a5df8ee admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.027189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.028334 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.028866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.029130 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.029767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.030766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.030766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:13:00.030766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:13:00.031983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.078064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 754/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:13:00.082370 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.084138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.153378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4e25-47b6-4582-b9e7-397ecb01f28b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.245400 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:00.258550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.259164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.259435 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.259693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.260368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.261395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.261395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:13:00.261395 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:13:00.262848 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.276912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 745/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:13:00.281590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.283071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.295161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55213e-bbc0-4d53-b67a-f8152b29c9b6 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.324764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:00.406075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.406683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.406958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.407225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.407876 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.408920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.408920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:13:00.408920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:13:00.409866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195c5a-f6ee-430b-9785-9c688ce4c8fa admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.422957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 755/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:13:00.427232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.428850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.464321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f36a2-ac63-44e0-bc91-82d520b7b205 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.565742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.566402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.566679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.566948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] PATH_INFO: `/v3/projects/2592ff28b62547d2a1e778fef9e0ccfe/users/7f80b18076fe46498915ab6d7fa0731b/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.590026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2592ff28b62547d2a1e778fef9e0ccfe, user_id=7f80b18076fe46498915ab6d7fa0731b, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.591062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.591062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:13:00.591062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:13:00.593070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832297a-7907-4ca9-aef8-3114d8ebe322 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.618678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 746/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:13:00 2022] PUT /identity/v3/projects/2592ff28b62547d2a1e778fef9e0ccfe/users/7f80b18076fe46498915ab6d7fa0731b/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:00.631719 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240639-110b-4808-adc0-f32b79b677ee None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.631979 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240639-110b-4808-adc0-f32b79b677ee None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.632271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240639-110b-4808-adc0-f32b79b677ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.698323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-d9240639-110b-4808-adc0-f32b79b677ee None None] MFA Rules not processed for user `7f80b18076fe46498915ab6d7fa0731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:00.699559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d9240639-110b-4808-adc0-f32b79b677ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.780707 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 756/1502] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:00.794628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.794914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.795189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.796601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 747/1503] 10.222.0.43 () {54 vars in 964 bytes} [Tue Sep 13 12:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:13:00.802826 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359547-8c56-4e31-bde1-d3c87b53b53b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.803309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359547-8c56-4e31-bde1-d3c87b53b53b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.803788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359547-8c56-4e31-bde1-d3c87b53b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.841623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:00.889196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-77359547-8c56-4e31-bde1-d3c87b53b53b None None] MFA Rules not processed for user `6338b9fc256a401083017d59fc4ceff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:00.890401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-77359547-8c56-4e31-bde1-d3c87b53b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.969323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 757/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Sep 13 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:00.979284 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.981647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.034430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:01.094537 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd44170-2283-4553-a0f5-b3cb850dc8cd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:01.178534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6338b9fc256a401083017d59fc4ceff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:01.179153 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:01.179428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:01.179694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:01.181333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.283090 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:01.284565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:01.288076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:01.304041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 748/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:13:01.350114 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828266-8b43-4df0-941c-faf5caa56c0d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:01.350563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828266-8b43-4df0-941c-faf5caa56c0d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:01.350675 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828266-8b43-4df0-941c-faf5caa56c0d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:01.351951 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 758/1506] 10.222.0.43 () {52 vars in 830 bytes} [Tue Sep 13 12:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:13:01.356131 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:01.357332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.458806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce189d-1b78-45fb-a3eb-08c223bc54c3 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:01.554138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:01.554759 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:01.555029 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:01.555291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] PATH_INFO: `/v3/users/7f80b18076fe46498915ab6d7fa0731b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:01.570165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f80b18076fe46498915ab6d7fa0731b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:01.571192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:01.571192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:13:01.571192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:13:01.572438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:01.582339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:01.642564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f80b18076fe46498915ab6d7fa0731b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.643014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f80b18076fe46498915ab6d7fa0731b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.643437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f80b18076fe46498915ab6d7fa0731b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.658734 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f80b18076fe46498915ab6d7fa0731b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.683232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f80b18076fe46498915ab6d7fa0731b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.701319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 749/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 12:13:01 2022] DELETE /identity/v3/users/7f80b18076fe46498915ab6d7fa0731b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:01.705891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f219-9335-4640-a967-465f76094858 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:01.706254 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f219-9335-4640-a967-465f76094858 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:01.706490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f219-9335-4640-a967-465f76094858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:01.766261 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f0f7f219-9335-4640-a967-465f76094858 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:01.767495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f0f7f219-9335-4640-a967-465f76094858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.846478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:01.860946 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 759/1508] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:01.871474 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:01.872850 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.987520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2350cd7-399b-42eb-aa5a-af0fe8b76709 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:02.045871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:02.068564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:02.069207 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:02.069483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:02.069743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:02.071396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:02.187920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:02.189378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ed69-0175-445b-82d7-e5bd168cbd21 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:02.207659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 750/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:13:02.581361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7f219-9335-4640-a967-465f76094858 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:02.583562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f0f7f219-9335-4640-a967-465f76094858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:02.605770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7f219-9335-4640-a967-465f76094858 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:02.716604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:02.717125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:02.717396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:02.717659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] PATH_INFO: `/v3/projects/2592ff28b62547d2a1e778fef9e0ccfe` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:02.728652 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2592ff28b62547d2a1e778fef9e0ccfe)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:02.729683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:02.729683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:13:02.729683 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:13:02.731427 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:02.793520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2592ff28b62547d2a1e778fef9e0ccfe', 'request_id': 'req-5209704b-82dc-48f1-ab68-d2a35abd007b'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:02.807351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2592ff28b62547d2a1e778fef9e0ccfe', 'request_id': 'req-5209704b-82dc-48f1-ab68-d2a35abd007b'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:02.818697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2592ff28b62547d2a1e778fef9e0ccfe', 'request_id': 'req-5209704b-82dc-48f1-ab68-d2a35abd007b'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:02.846169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] The token cache is being invalidate because project 2592ff28b62547d2a1e778fef9e0ccfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:13:02.846169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:02.846681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-5209704b-82dc-48f1-ab68-d2a35abd007b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:02.848156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 760/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 12:13:02 2022] DELETE /identity/v3/projects/2592ff28b62547d2a1e778fef9e0ccfe => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:12.204954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=62 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:12.842053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:18.641808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:18.642425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:18.642425 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:18.643742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:18.648521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb93c08-916b-45ed-97ea-f6c255a5d844 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:18.648970 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb93c08-916b-45ed-97ea-f6c255a5d844 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:18.649162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb93c08-916b-45ed-97ea-f6c255a5d844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:18.729975 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ebb93c08-916b-45ed-97ea-f6c255a5d844 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:18.731165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ebb93c08-916b-45ed-97ea-f6c255a5d844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:18.833941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:18.989722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:18.991782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:19.108987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a60d-77c5-4c84-bd51-c304b64462d0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:19.114501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:19.115110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:19.115387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:19.115666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:19.124616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:19.126195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aa968-7661-45dd-8200-d75a594721ae service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:19.136399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 752/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:20.219711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd9b1-8809-4281-a926-f9a020bdc9fb None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:20.220265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd9b1-8809-4281-a926-f9a020bdc9fb None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:20.220265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd9b1-8809-4281-a926-f9a020bdc9fb None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:20.221631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:20.227741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29341ae5-1042-4b88-b5e4-c80413cd0a9b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:20.228182 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29341ae5-1042-4b88-b5e4-c80413cd0a9b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:20.228321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29341ae5-1042-4b88-b5e4-c80413cd0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:20.247596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-29341ae5-1042-4b88-b5e4-c80413cd0a9b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:20.248820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-29341ae5-1042-4b88-b5e4-c80413cd0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:20.257133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:20.408469 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdd9b1-8809-4281-a926-f9a020bdc9fb None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:20.422744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdd9b1-8809-4281-a926-f9a020bdc9fb None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:20.428082 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:20.428603 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:20.428881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:20.429150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:20.437760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:20.439319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ce54-b656-4ac5-ace8-8f2a375d4161 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:20.448573 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 763/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:22.910236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28eec6-d4f7-4281-bf76-2a175e813a5e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:22.910778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28eec6-d4f7-4281-bf76-2a175e813a5e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:22.910778 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28eec6-d4f7-4281-bf76-2a175e813a5e None None] PATH_INFO: `/v3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:22.912075 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 754/1517] 10.222.0.62 () {54 vars in 925 bytes} [Tue Sep 13 12:14:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:14:22.917994 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c24e0-2fcf-4ae9-b9a1-a3ecb73e8ba4 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:22.918433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c24e0-2fcf-4ae9-b9a1-a3ecb73e8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:22.918545 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c24e0-2fcf-4ae9-b9a1-a3ecb73e8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:22.979478 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ad4c24e0-2fcf-4ae9-b9a1-a3ecb73e8ba4 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:22.980705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ad4c24e0-2fcf-4ae9-b9a1-a3ecb73e8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:22.997209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:23.052736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 764/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 13 12:14:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:30.242696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=56 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:31.932910 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170561-360a-4fb5-87db-d5794d993a6b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:31.933613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170561-360a-4fb5-87db-d5794d993a6b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:31.933613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170561-360a-4fb5-87db-d5794d993a6b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:31.934812 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 755/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:31.941360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:31.942213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:31.942497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:31.963139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:31.964375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:31.974067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 765/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:32.135820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba612f4-69ae-41be-8eda-1772f4bd39f4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:32.136052 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba612f4-69ae-41be-8eda-1772f4bd39f4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:32.136495 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba612f4-69ae-41be-8eda-1772f4bd39f4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:32.137864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 756/1521] 10.222.0.43 () {54 vars in 961 bytes} [Tue Sep 13 12:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:32.138390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:32.144118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:32.144401 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:32.144672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:32.152343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c2ea-f4b4-4bf3-8bc5-f34c3ce0872b None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:32.165482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:32.165482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:32.165482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:32.165482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:32.165943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:32.167021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:32.174371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:32.175943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 757/1522] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Sep 13 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:14:32.176080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62399cd7-66f0-44a0-9073-ecfa0a5cfba1 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:32.184489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:32.186192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 766/1523] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:14:32.194764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df3f1-6c7a-47db-8d7e-ecbad1127b29 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:32.200094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:32.200836 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:32.201118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:32.201388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:32.210638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:32.212357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8660d-df9a-472a-ae00-3180527c7955 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:32.222410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 758/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:14:33.278339 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3489d-93b9-479e-ab79-3433cf9368ce None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:33.278894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3489d-93b9-479e-ab79-3433cf9368ce None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:33.278894 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3489d-93b9-479e-ab79-3433cf9368ce None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:33.280379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:33.287026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd941-37da-40da-ad1a-2998ad8824b0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:33.287515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd941-37da-40da-ad1a-2998ad8824b0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:33.287631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd941-37da-40da-ad1a-2998ad8824b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:33.307342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1d7cd941-37da-40da-ad1a-2998ad8824b0 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:33.308544 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1d7cd941-37da-40da-ad1a-2998ad8824b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:33.317388 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:33.468859 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3489d-93b9-479e-ab79-3433cf9368ce None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:33.482698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3489d-93b9-479e-ab79-3433cf9368ce None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:33.488079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:33.488663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:33.488937 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:33.489204 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:33.497094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:33.498635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f003-6620-4ce8-a6a6-b7d3ecd3a816 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:33.508072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 768/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:37.679288 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:37.679851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:37.679851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:37.681214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:37.686604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c81d-fb22-4e95-b922-55869a33e084 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:37.687599 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c81d-fb22-4e95-b922-55869a33e084 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:37.687701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c81d-fb22-4e95-b922-55869a33e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:37.706731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-14d9c81d-fb22-4e95-b922-55869a33e084 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:37.707920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-14d9c81d-fb22-4e95-b922-55869a33e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:37.716051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:38.011529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:38.013279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:38.092418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acd0c-0214-4132-a057-3fafb328a1ca None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:38.096562 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:38.097161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:38.097440 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:38.097712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:38.106635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:38.108085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5ebb-3715-473c-843e-4c2583dd698d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:38.118096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 761/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:40.281476 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:40.282062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:40.282062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:40.283342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:40.288646 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4335-0fcd-4630-bb17-67e70e0d4908 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:40.289073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4335-0fcd-4630-bb17-67e70e0d4908 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:40.289173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4335-0fcd-4630-bb17-67e70e0d4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:40.308839 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-901e4335-0fcd-4630-bb17-67e70e0d4908 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:40.310025 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-901e4335-0fcd-4630-bb17-67e70e0d4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:40.318303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:40.604150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:40.605832 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:40.619002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1e4c9-4fc5-41eb-b3d1-2012d80adf42 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:40.622482 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:40.623073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:40.624341 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:40.624632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:40.633534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:40.634943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643965b8-076a-4b54-bcf5-c73719f97c52 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:40.646497 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 771/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:44.471036 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.471602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.471602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.472920 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:44.478333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c6c0-970d-4175-9668-1bc613a9447d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.478765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c6c0-970d-4175-9668-1bc613a9447d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.478880 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c6c0-970d-4175-9668-1bc613a9447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.498404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f3b7c6c0-970d-4175-9668-1bc613a9447d None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:44.499591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f3b7c6c0-970d-4175-9668-1bc613a9447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:44.507583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:14:44.813003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:44.814694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:44.894867 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e0ed-14fb-4fa8-a36c-7c77bf2e4167 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:44.898755 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6338b9fc256a401083017d59fc4ceff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:44.899360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.899644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.899913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.909356 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:44.910782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497976-271c-40b8-9821-0a52cc1d9759 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:44.920061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 764/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:47.067139 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:47.067698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:47.067698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:47.069034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:47.074296 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1de00-3630-466e-9b30-199f5a5ecc83 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:47.074713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1de00-3630-466e-9b30-199f5a5ecc83 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:47.074806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1de00-3630-466e-9b30-199f5a5ecc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:47.094542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7fe1de00-3630-466e-9b30-199f5a5ecc83 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:47.095709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7fe1de00-3630-466e-9b30-199f5a5ecc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:47.103419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:47.409864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:47.411547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:47.425404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965173f9-5b1b-4926-8656-19591ddf1d78 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:47.429354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6338b9fc256a401083017d59fc4ceff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:47.429953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:47.430226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:47.430494 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:47.442633 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:47.444081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da86a6-0e76-489c-9969-ea4c663e5034 service cinder] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:47.455980 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 774/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:57.089700 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:57.450340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=56 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:06.904609 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b04c6-4b29-4997-9b76-3b4836430a5f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.905215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b04c6-4b29-4997-9b76-3b4836430a5f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.905215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b04c6-4b29-4997-9b76-3b4836430a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.906196 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cdcb-1c37-4155-89e3-09f8f405f175 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.906588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cdcb-1c37-4155-89e3-09f8f405f175 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.906746 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cdcb-1c37-4155-89e3-09f8f405f175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.926315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-188b04c6-4b29-4997-9b76-3b4836430a5f None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:06.926598 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-d1c6cdcb-1c37-4155-89e3-09f8f405f175 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:06.927565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-188b04c6-4b29-4997-9b76-3b4836430a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:06.927775 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d1c6cdcb-1c37-4155-89e3-09f8f405f175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:06.935912 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 766/1540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:06.939596 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 775/1541] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:06.944007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.944291 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.944572 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.944819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.945125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.945394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.964115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:06.965102 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:06.965307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:06.966270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:06.973325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 767/1542] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:06.974728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 776/1543] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:06.977631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:06.979555 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:06.987351 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296073-f51a-4d40-913f-c88ab8008f41 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:06.988766 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd349-ec6c-4a71-a915-adf26fcac1ed None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:06.992150 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:06.992750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.993026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.993297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.993569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:06.993943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:06.994224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:06.994338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:06.994502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:06.995321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:06.995857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:06.995857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:16:06.995857 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:16:06.996156 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:06.996253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:06.996774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:06.997799 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.008932 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 768/1544] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 12:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:07.013417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 777/1545] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 12:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:07.016837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.017528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.027222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260e150-435b-40b5-bfff-c7c2eb5445e2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.028004 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970105cb-46c1-4031-84ba-14c3767b2a28 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.031796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.032492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.032618 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.032770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.033037 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.033188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.033473 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.033678 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.033801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.034360 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.035393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:07.035393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:16:07.035393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:16:07.035630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.036616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.080731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 769/1546] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:07.080731 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.081399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 778/1547] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:07.082475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.148816 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfd161-5c2f-404b-b765-cbec6d878a6d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.149014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d82b-ffb6-48da-a96c-4b69c1eb51c6 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.153658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.154023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.154271 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.154547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.154789 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.154898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.155074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.155348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.155451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.156145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.157169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:07.157169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:16:07.157169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:16:07.157461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.158379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.186402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 779/1548] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:07.186669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 770/1549] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:07.187784 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.187976 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.198096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf64731-c083-4cdb-a19b-2fb58fa06b0a admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.198416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b2586-aa19-44f6-901d-8f7ac54c80a6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.203355 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.203636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.203984 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.204253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.204389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.204523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.204635 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.204828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.205164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.205466 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.206744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.207041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.217722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 780/1550] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:07.221066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 771/1551] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:07.221838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.221983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.232257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fb2f-56e3-4f69-a024-cf92e321e077 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.232647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275ac7b-011a-4a7d-b99a-1fd19260c24e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.236822 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.237298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.237464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.237676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.237882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.238009 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.238162 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.238433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.238783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.239077 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.240391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.240950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.251393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 781/1552] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:07.255122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 772/1553] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:07.255467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.255929 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.265302 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a63815-774c-4159-8c79-33316266e54e admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.265947 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b56514-0f58-4760-8874-79f8c645ee31 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.270813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.270982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.271475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.271619 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.271738 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.271835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.272044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] PATH_INFO: `/v3/projects/c50d298db1d041fabe16a94682d9392b/users/07253b08109e41538e37039fd8399148/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.272161 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] PATH_INFO: `/v3/projects/5ae4a2e63f6941a6ab0046caf8687879/users/457fd373adc2416086db90bb61de9429/roles/0596a83a84af4342b35541050fc02f35` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.288375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50d298db1d041fabe16a94682d9392b, user_id=07253b08109e41538e37039fd8399148, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.288608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae4a2e63f6941a6ab0046caf8687879, user_id=457fd373adc2416086db90bb61de9429, role_id=0596a83a84af4342b35541050fc02f35)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.289439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:07.289439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:16:07.289439 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:16:07.291188 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68697-d337-4f0b-9aa5-a90d5d9b6a71 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.292282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216295d-bca9-4ba3-9862-edf0c2fd64fc admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.305636 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 773/1554] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:07 2022] PUT /identity/v3/projects/5ae4a2e63f6941a6ab0046caf8687879/users/457fd373adc2416086db90bb61de9429/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:07.307382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 782/1555] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:07 2022] PUT /identity/v3/projects/c50d298db1d041fabe16a94682d9392b/users/07253b08109e41538e37039fd8399148/roles/0596a83a84af4342b35541050fc02f35 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:07.310804 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402825dd-eaec-430c-b50f-b9552981614c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.311087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402825dd-eaec-430c-b50f-b9552981614c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.311363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402825dd-eaec-430c-b50f-b9552981614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.312625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.312895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.313167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.330237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-402825dd-eaec-430c-b50f-b9552981614c None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:07.331444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-402825dd-eaec-430c-b50f-b9552981614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:07.332722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] MFA Rules not processed for user `25e6c04dcaa6467c806fd0a095469485`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:07.333864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:07.373941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:07.376160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:07.395687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 774/1556] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:07.396742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 783/1557] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:07.406687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.406875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402825dd-eaec-430c-b50f-b9552981614c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.464487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0892ab-0478-4885-84d5-89445152fa86 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.464753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402825dd-eaec-430c-b50f-b9552981614c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.468092 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.468273 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.468701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.468974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.469079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.469189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.469286 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.469385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.478208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.478631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.480324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.480691 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5ba80-8458-4c6a-90d9-87548616acac service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.490501 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 775/1558] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:07.490958 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 784/1559] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:12.771059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.771059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.771059 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.810637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] MFA Rules not processed for user `07253b08109e41538e37039fd8399148`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:12.812907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:12.959336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 776/1560] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:12.968753 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.980644 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7bb6-3d43-4e6c-9a25-e1129c94c7ad service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.985823 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.986438 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.986714 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.986983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.987624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.989571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3ee2-8cee-47c2-bbfb-6ef530ec0aaf admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.040323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.042133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 785/1561] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:12 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:13.054144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3969ba-d060-4491-b3ec-903093076b80 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.059904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.060257 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.060503 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.127829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:13.129378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:13.199101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.199740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.200053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.200327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.201145 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.203396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.250824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 777/1562] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:13 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:13.252991 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 786/1563] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:13.260924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.261528 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.275762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef71f5-407a-459f-9ea4-b273ddae198d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.279444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755345b-a9fc-40c8-9238-3368c93468d9 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.282051 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.282905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.282905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.283484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.284942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.287258 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.287918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.288885 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.289737 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.290167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.291225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.292571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.297333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.307340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 778/1564] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:13.312974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.327605 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456bbb5-5ea3-4fec-8ebd-d5d5d4b5c3d6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.338523 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.339211 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.339496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.339771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] PATH_INFO: `/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf/users/d69843a560134787b447d8a91606cfce/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.351430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 787/1565] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:13 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:13.353017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.366085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c20c3e0f934e6199e3a1f72327eedf, user_id=d69843a560134787b447d8a91606cfce, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.368840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.389055 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 779/1566] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:13 2022] PUT /identity/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf/users/d69843a560134787b447d8a91606cfce/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:13.392907 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.431908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.479071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13687b0-3059-4293-90d0-92b7061e19d7 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.492725 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80ade-174b-44ec-ab44-8b1638968d86 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.498628 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.499489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.499489 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.499765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.500428 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.502099 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.514220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 780/1567] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:13.518837 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.530070 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadbc7d-925b-41c9-91ed-2f8940ff28e6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.537465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.538235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.538578 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.538921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] PATH_INFO: `/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf/users/d69843a560134787b447d8a91606cfce/roles/83fb245122344892b0377532854af000` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.541157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c20c3e0f934e6199e3a1f72327eedf, user_id=d69843a560134787b447d8a91606cfce, role_id=83fb245122344892b0377532854af000)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.545140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.564583 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 781/1568] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:13 2022] PUT /identity/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf/users/d69843a560134787b447d8a91606cfce/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:13.565901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.566634 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.567043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.567317 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] PATH_INFO: `/v3/users` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.568026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.569989 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.600007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 788/1569] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:13 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:13.601592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.710381 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f748-7b73-4781-91b9-78dd0d7c1db5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.716842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.719203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.719565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.719917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.720729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.724554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.743679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 782/1570] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:13.748828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.760064 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f948a-4783-4a23-a639-c6d3a99d669b admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.766430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.767138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.767419 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.767748 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] PATH_INFO: `/v3/projects/623920c9e7df4df481523a1c80c6d43a/users/8971b1e4bcf147139e8b671795e66843/roles/83fb245122344892b0377532854af000` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.800797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623920c9e7df4df481523a1c80c6d43a, user_id=8971b1e4bcf147139e8b671795e66843, role_id=83fb245122344892b0377532854af000)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.809040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.838904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 789/1571] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:13 2022] PUT /identity/v3/projects/623920c9e7df4df481523a1c80c6d43a/users/8971b1e4bcf147139e8b671795e66843/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:13.843511 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.863662 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b946-60b6-42dc-9b18-04339c60df3f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.986563 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.999819 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.000390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.000716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.000988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.001667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.003267 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138b939-767c-4486-ba93-a32e331b6e46 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.024122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 783/1572] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:14.029017 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.042669 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cfad-bbd1-4c1b-945d-a9b687fef973 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.048065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.048844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.049194 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.049526 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] PATH_INFO: `/v3/projects/623920c9e7df4df481523a1c80c6d43a/users/8971b1e4bcf147139e8b671795e66843/roles/83fb245122344892b0377532854af000` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.051574 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=623920c9e7df4df481523a1c80c6d43a, user_id=8971b1e4bcf147139e8b671795e66843, role_id=83fb245122344892b0377532854af000)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.054349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.078591 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 790/1573] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:14 2022] PUT /identity/v3/projects/623920c9e7df4df481523a1c80c6d43a/users/8971b1e4bcf147139e8b671795e66843/roles/83fb245122344892b0377532854af000 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:20.053140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb872-9988-4ccb-a844-a3c8fa3e2e18 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.054136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb872-9988-4ccb-a844-a3c8fa3e2e18 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.054554 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb872-9988-4ccb-a844-a3c8fa3e2e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.091112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1cbcb872-9988-4ccb-a844-a3c8fa3e2e18 None None] MFA Rules not processed for user `d69843a560134787b447d8a91606cfce`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:20.092895 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1cbcb872-9988-4ccb-a844-a3c8fa3e2e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:20.229003 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 784/1574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:20.247601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.249715 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:20.406744 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af49d-8507-44d1-a06d-92cf247f48dd admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.412688 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4d52c9c7484014bef4a61bd9fd5ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.413650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.413918 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.414193 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.477594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:20.526654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.528908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502073-2be9-4ace-ace1-bd83eae198e4 service glance] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.549787 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 791/1575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:20.851437 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.851727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.852031 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.866107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.866399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.867169 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.898066 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] MFA Rules not processed for user `8971b1e4bcf147139e8b671795e66843`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:20.901431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:20.942307 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:20.943540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:21.004081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 785/1576] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:21.013326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:21.028514 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4dca4-69d7-4ab0-a568-d6bbca6e944f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:21.032418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4d52c9c7484014bef4a61bd9fd5ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:21.033165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:21.033326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:21.033600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:21.076141 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 792/1577] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:21.106033 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:21.107871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c81d4-d094-4397-a554-031935230603 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:21.112121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:21.120021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 786/1578] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:16:21.179783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:21.181730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:21.316433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698de4-3d8c-4322-aaa0-530040cdd9bc None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:21.322960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:21.323576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:21.323851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:21.324163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:21.333928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:21.335542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:21.349952 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 793/1579] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:16:23.052144 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2face0-b426-4b60-b8b1-0a061f041219 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.052963 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2face0-b426-4b60-b8b1-0a061f041219 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.053413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2face0-b426-4b60-b8b1-0a061f041219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.087136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8d2face0-b426-4b60-b8b1-0a061f041219 None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:23.089256 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8d2face0-b426-4b60-b8b1-0a061f041219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:23.120492 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 787/1580] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:23.125788 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.138960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80cec-6bdd-4bd1-a15f-33115617abc0 service swift] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.160992 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.161768 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.162118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.162465 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.176180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.177987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787557b-423e-4d36-9aca-9a9f166800a6 service swift] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.182711 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=100 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:23.235954 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 794/1581] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:16:32.596769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ee56-91b8-4728-b8b0-52e50b39df61 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.597314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ee56-91b8-4728-b8b0-52e50b39df61 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.597314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ee56-91b8-4728-b8b0-52e50b39df61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.616209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3416ee56-91b8-4728-b8b0-52e50b39df61 None None] MFA Rules not processed for user `07253b08109e41538e37039fd8399148`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:32.617398 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3416ee56-91b8-4728-b8b0-52e50b39df61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:32.624588 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 788/1582] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:32.924322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74880a-2e8d-41c8-a4cf-4c0c12b58505 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.925002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74880a-2e8d-41c8-a4cf-4c0c12b58505 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.925002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74880a-2e8d-41c8-a4cf-4c0c12b58505 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.926487 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 795/1583] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 12:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:32.932728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e293b0-daef-4784-8675-9de7492ddefc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.933111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e293b0-daef-4784-8675-9de7492ddefc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.933631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e293b0-daef-4784-8675-9de7492ddefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.971354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c3e293b0-daef-4784-8675-9de7492ddefc None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:32.972577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c3e293b0-daef-4784-8675-9de7492ddefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.044125 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 789/1584] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:33.049520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.049835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.050129 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.051510 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 796/1585] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:33.057402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7221932-bfb5-444e-b728-cf2261a5ce11 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.057687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7221932-bfb5-444e-b728-cf2261a5ce11 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.057962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7221932-bfb5-444e-b728-cf2261a5ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.078685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b7221932-bfb5-444e-b728-cf2261a5ce11 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:33.079870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b7221932-bfb5-444e-b728-cf2261a5ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.089058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 790/1586] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:33.105496 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:33.107566 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.121765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066f5f-c9c5-4f56-b227-54343745425d None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:33.125316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4d52c9c7484014bef4a61bd9fd5ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:33.125917 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.126197 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.126490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.137423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:33.138827 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5efc06-a0ba-4a70-bddf-d8426bb153ee service glance] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:33.149676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 797/1587] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:33.493069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1032-9553-4754-9a0a-582a7da1a29b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.493348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1032-9553-4754-9a0a-582a7da1a29b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.493612 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1032-9553-4754-9a0a-582a7da1a29b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.494982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 791/1588] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:33.500640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76fb12-5961-471f-b8fc-6a5d788ebf8d None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.500928 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76fb12-5961-471f-b8fc-6a5d788ebf8d None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.501203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76fb12-5961-471f-b8fc-6a5d788ebf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.538379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-6f76fb12-5961-471f-b8fc-6a5d788ebf8d None None] MFA Rules not processed for user `4003563bd8444eeea77159305220aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:33.540393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-6f76fb12-5961-471f-b8fc-6a5d788ebf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.590854 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 798/1589] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:33.603056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e1032-9553-4754-9a0a-582a7da1a29b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:33.613840 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e1032-9553-4754-9a0a-582a7da1a29b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:33.618163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:33.618815 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.619094 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.619300 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.627154 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:33.628783 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9520b5-629b-4d21-af07-f4ad5ca99c75 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:33.638034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 792/1590] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:34.029378 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609d73-5407-44ec-b333-5b129d51b699 None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.030208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609d73-5407-44ec-b333-5b129d51b699 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.030208 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609d73-5407-44ec-b333-5b129d51b699 None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.041708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 799/1591] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 12:16:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:16:34.048340 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae22f5-c68a-4e52-b9c3-105cd1fd95e5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.048626 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae22f5-c68a-4e52-b9c3-105cd1fd95e5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.048900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae22f5-c68a-4e52-b9c3-105cd1fd95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.063663 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63609d73-5407-44ec-b333-5b129d51b699 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.071045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d3ae22f5-c68a-4e52-b9c3-105cd1fd95e5 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:34.072371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d3ae22f5-c68a-4e52-b9c3-105cd1fd95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:34.081957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 793/1592] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:34.088246 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1395-a24c-4d30-af9b-5a30a1adb6c2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.088608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1395-a24c-4d30-af9b-5a30a1adb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.088978 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1395-a24c-4d30-af9b-5a30a1adb6c2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.090451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 794/1593] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 12:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:34.095667 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.095950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.096248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.115456 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:34.116694 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:34.126484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 795/1594] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:34.136110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63609d73-5407-44ec-b333-5b129d51b699 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.139262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.143617 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.144431 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.144705 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.144971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.146747 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:34.152073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebde5-3443-4411-95d7-258f7df99e51 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.159061 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.159491 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.160158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.160434 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.160695 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.160792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7573bf6-64b6-4f97-a394-8abb7437b28a service placement] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.170913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 800/1595] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:16:34.172436 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.173916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.185326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 796/1596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:16:36.150133 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5ffb-f642-4fa4-95be-9391b6c0c7bc None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.150639 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5ffb-f642-4fa4-95be-9391b6c0c7bc None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.150726 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5ffb-f642-4fa4-95be-9391b6c0c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:36.171485 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-0eff5ffb-f642-4fa4-95be-9391b6c0c7bc None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:36.172716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-0eff5ffb-f642-4fa4-95be-9391b6c0c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:36.180178 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 801/1597] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:36.194049 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:36.206213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d023-1169-4498-9d57-394d85327ce4 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:36.212165 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:36.212764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.213043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.213310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:36.221871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:36.223464 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:36.232105 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 797/1598] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:16:46.165342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=71 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.228977 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=71 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:52.428014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3d32d-68c7-4c09-bfc2-28a720794ac6 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.428615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3d32d-68c7-4c09-bfc2-28a720794ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.428615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3d32d-68c7-4c09-bfc2-28a720794ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.450044 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-2ae3d32d-68c7-4c09-bfc2-28a720794ac6 None None] MFA Rules not processed for user `4003563bd8444eeea77159305220aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:52.451410 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-2ae3d32d-68c7-4c09-bfc2-28a720794ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:52.458729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 802/1599] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 13 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:52.470507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:52.479847 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30066-9686-49cd-894f-97e065fdac27 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:52.483914 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:52.484547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.484821 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.485084 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.493140 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:52.494653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3ee9-0d19-48fc-b121-d5ee2016738d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:52.503087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 798/1600] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:53.300751 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2acf-12fb-4d34-86a1-d1c38cf855ec None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.301166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2acf-12fb-4d34-86a1-d1c38cf855ec None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.301515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2acf-12fb-4d34-86a1-d1c38cf855ec None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.302988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 803/1601] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:53.324654 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1694112-2317-4b23-add6-d0743ae6d65b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.324938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1694112-2317-4b23-add6-d0743ae6d65b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.325212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1694112-2317-4b23-add6-d0743ae6d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.346723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a1694112-2317-4b23-add6-d0743ae6d65b None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:53.347940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1694112-2317-4b23-add6-d0743ae6d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:53.359483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 799/1602] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:53.373085 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2acf-12fb-4d34-86a1-d1c38cf855ec None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.390416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2acf-12fb-4d34-86a1-d1c38cf855ec None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:53.403444 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:53.408985 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.409623 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.410243 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.422080 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:53.423600 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15da52-b648-4d6a-b478-092b84d23fd8 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:53.435797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 804/1603] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:01.456698 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472eff-bb01-40f0-a034-9f4762d03f8a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.457262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472eff-bb01-40f0-a034-9f4762d03f8a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.457262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472eff-bb01-40f0-a034-9f4762d03f8a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.458613 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 800/1604] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:01.468924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.469499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.469499 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.490498 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:01.491739 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:01.501126 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 805/1605] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:17:01.513647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0472eff-bb01-40f0-a034-9f4762d03f8a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.529459 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0472eff-bb01-40f0-a034-9f4762d03f8a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.535320 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.535949 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.536260 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.536536 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.546525 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.548142 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc8f1-795c-4563-b69f-f5579d21c4aa service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.559266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 801/1606] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:11.485380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=12 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:11.554813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=15 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:24.863587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.874053 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbc6df-70a5-423e-9de3-8093b76610ba None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.878220 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.878860 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.879138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.879413 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.890608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.892160 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f5de6-c7e1-4bd7-8774-b2e823d466ac service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.904262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 806/1607] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:26.921214 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b523-c2ea-4bf1-a1f0-0927559d49e9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.922069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b523-c2ea-4bf1-a1f0-0927559d49e9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.922343 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b523-c2ea-4bf1-a1f0-0927559d49e9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.924195 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 802/1608] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:26.930780 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eedc-5858-4f40-8846-e5eb0c44b038 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.931891 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eedc-5858-4f40-8846-e5eb0c44b038 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.932502 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eedc-5858-4f40-8846-e5eb0c44b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.954375 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-9021eedc-5858-4f40-8846-e5eb0c44b038 None None] MFA Rules not processed for user `056e6c0714cf4827a3b118d0bddfb182`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:26.955590 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-9021eedc-5858-4f40-8846-e5eb0c44b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:26.970548 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 807/1609] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:17:26.989266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17b523-c2ea-4bf1-a1f0-0927559d49e9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.008530 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17b523-c2ea-4bf1-a1f0-0927559d49e9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.015390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.015997 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.016272 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.016689 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.026782 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.028824 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ec286-7539-490c-91cb-01e2813e4934 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.040337 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 803/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:17:31.867480 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd003d-c395-479f-b9cd-6a40206063e7 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.867983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd003d-c395-479f-b9cd-6a40206063e7 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.868225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd003d-c395-479f-b9cd-6a40206063e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.888454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-93fd003d-c395-479f-b9cd-6a40206063e7 None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:31.889658 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-93fd003d-c395-479f-b9cd-6a40206063e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:31.897185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 808/1611] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:17:37.036904 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:41.881741 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=12 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:27.215513 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:27.216073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:27.216073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:27.235107 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:27.236336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:27.243065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 804/1612] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:18:37.230454 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:46.501382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b1dbe-4e52-48f4-9673-2319511991de None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.501901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b1dbe-4e52-48f4-9673-2319511991de None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.501988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b1dbe-4e52-48f4-9673-2319511991de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.522043 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-910b1dbe-4e52-48f4-9673-2319511991de None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:46.523252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-910b1dbe-4e52-48f4-9673-2319511991de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:46.530460 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 809/1613] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:18:46.572965 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:46.585266 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328fe2-3439-468e-ac50-6001843195ef None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:46.590192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:46.590793 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.591073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.591344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.599385 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:46.601519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb81b2-8c0f-4a41-a444-4069478a5657 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:46.609461 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 805/1614] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:18:52.006921 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.007467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.007467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.027533 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:52.028797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:52.035892 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 810/1615] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:18:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:18:52.334898 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e7cb-b3f3-4074-8591-1e1d2905aacb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.335479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e7cb-b3f3-4074-8591-1e1d2905aacb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.335479 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e7cb-b3f3-4074-8591-1e1d2905aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.355336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b413e7cb-b3f3-4074-8591-1e1d2905aacb None None] MFA Rules not processed for user `4003563bd8444eeea77159305220aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:52.356645 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b413e7cb-b3f3-4074-8591-1e1d2905aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:52.363416 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 806/1616] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:18:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:18:52.376015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:52.386760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559c4c0-d27a-49c0-a41a-4efc02805fbb None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:52.390363 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:52.390973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.391255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.391529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.400763 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:52.402203 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:52.411408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 811/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:18:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:19:02.349865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=9 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:02.407164 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=12 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:29.375467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0cd7-8fc9-451c-a062-39449efd840b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.376034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0cd7-8fc9-451c-a062-39449efd840b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.376034 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0cd7-8fc9-451c-a062-39449efd840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.394924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b61c0cd7-8fc9-451c-a062-39449efd840b None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:29.396062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b61c0cd7-8fc9-451c-a062-39449efd840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:29.403344 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 807/1618] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:19:29.417535 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:29.429925 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab0fc-1686-4e90-befe-68ac1edb31e0 service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:29.435058 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:29.435653 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.435926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.436238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.444666 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:29.446225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:29.454722 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 812/1619] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:19:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:19:39.390027 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:39.451429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=6 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:56.571490 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:56.571944 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:56.572062 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:56.592021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:56.593216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:56.600073 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 808/1620] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:19:57.872865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:57.884767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3196d06-cff5-4cbd-b541-625247cbfbe4 service swift] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:57.890174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:57.890797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:57.891069 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:57.891333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:57.900729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:57.902310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:57.913868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 813/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:20:06.587067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:20:07.909309 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=6 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:20:15.523319 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:20:15.535089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a1d6-12e5-42dd-b163-a1d7ed95ebc3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:20:15.538792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:20:15.539397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:20:15.539672 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:20:15.539938 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:20:15.550509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:20:15.551950 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:20:15.561483 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 809/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:20:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:20:25.557252 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:46.038212 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:46.051026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375f37b-2b87-4912-86d6-2c89ae7281c6 service placement] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:46.056312 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:46.056901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:46.057192 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:46.057452 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:46.064926 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:46.066472 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:46.075079 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 814/1623] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:46.124875 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:46.134377 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fc8cc-d942-4b88-b41d-5c12d766e43a service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:46.138028 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:46.138615 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:46.138889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:46.139184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:46.149138 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:46.150584 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:46.162234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 810/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:47.997306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:48.059297 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c0df-2eba-4fe4-8117-6710b2bfcb6b service nova] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:48.064042 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6338b9fc256a401083017d59fc4ceff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:48.065074 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:48.065418 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:48.066021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:48.078608 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:48.080310 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc50d52-176b-4732-a1f0-8ae20b90ffb4 service cinder] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:48.092998 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 815/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:54.250026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:54.262224 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c175-12cf-466b-a1df-fc65c690b765 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:54.270829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:54.271838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:54.272708 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:54.273183 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:54.283931 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:54.286000 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:54.296971 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 811/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:55.567706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865dc2-ac43-4727-bf10-5e79e7ec1325 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:55.568209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865dc2-ac43-4727-bf10-5e79e7ec1325 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:55.568292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865dc2-ac43-4727-bf10-5e79e7ec1325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:55.588177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-c3865dc2-ac43-4727-bf10-5e79e7ec1325 None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:55.589371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-c3865dc2-ac43-4727-bf10-5e79e7ec1325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:55.597531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 816/1627] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:21:55.644173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:55.655543 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b44656-0fb0-40d0-ba02-2c6d5529c06f service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:55.660540 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:55.661168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:55.661447 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:55.661723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:55.669637 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:55.671216 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:55.679238 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 812/1628] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:21:56.164226 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91beea3-13c5-496b-887e-a30c1beab641 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:56.164531 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91beea3-13c5-496b-887e-a30c1beab641 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:56.164803 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91beea3-13c5-496b-887e-a30c1beab641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:56.184463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-e91beea3-13c5-496b-887e-a30c1beab641 None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:56.186294 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-e91beea3-13c5-496b-887e-a30c1beab641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:56.193357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 817/1629] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:21:56.205404 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:56.215758 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7149854-e5d3-4229-aece-0efde5ee6350 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:56.221650 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:56.222248 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:56.222542 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:56.222813 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:56.231200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:56.233348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:56.241571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 813/1630] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:21:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:22:04.794111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d03eb-791c-4101-a8b7-7ab62151362f None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:04.794630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d03eb-791c-4101-a8b7-7ab62151362f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:04.794630 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d03eb-791c-4101-a8b7-7ab62151362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:04.813983 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-0c5d03eb-791c-4101-a8b7-7ab62151362f None None] MFA Rules not processed for user `07253b08109e41538e37039fd8399148`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:22:04.815558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-0c5d03eb-791c-4101-a8b7-7ab62151362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:22:04.822742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 818/1631] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:22:06.238253 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=24 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:06.403604 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:06.414882 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9809-6d99-43c9-b6db-d2f0418a7ce0 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:06.420534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:06.421146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:06.421423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:06.421693 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:06.430453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:06.432067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:06.447087 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 814/1632] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:07.862781 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:07.863277 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:07.863379 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:07.881865 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:22:07.883045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:22:07.890147 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 819/1633] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:22:07.903232 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:07.914455 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640da0e-6850-4f18-bb58-a8341f9518d9 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:07.920868 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:07.921559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:07.921901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:07.922235 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:07.931306 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:07.933371 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:07.941842 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 815/1634] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:22:17.819205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:17.824274 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=45 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:17.829777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c87d9-0cd5-4b7b-bbe6-0d30de95b831 None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:17.834382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:17.835006 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:17.835358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:17.835625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:17.844336 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:17.845761 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:17.853770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 820/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:22:17.938394 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=12 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:25.946015 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:25.958792 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da7d9-f7a0-4346-8836-a4ef00182817 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:25.965262 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:25.965870 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:25.966146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:25.966415 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:25.975794 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:25.977342 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:25.988671 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 816/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:27.850315 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=5 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:35.458521 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:35.472060 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4127-2c3d-4449-9c71-b567060ac32a service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:35.477576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:35.478177 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:35.478453 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:35.478720 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:35.487134 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:35.488721 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:35.497723 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 821/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:35.984368 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:39.098696 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:39.108432 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c8d1-65d4-4124-a62a-ab14504e9cfd service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:39.112184 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:39.112796 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:39.113071 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:39.113338 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:39.122922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:39.124595 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268bb2f-8d7c-4a2a-90a1-eae2cd88cae4 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:39.134298 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 817/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:40.934685 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:40.947014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c31f6-9de5-4077-a429-f863ee659057 service nova] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:40.954321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:40.955002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:40.955280 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:40.955550 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:40.966110 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:40.967776 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:40.979269 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 822/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:41.535547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:41.535547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:41.535547 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:41.560357 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:22:41.561930 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:22:41.573270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 818/1640] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:22:42.231834 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:42.244534 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7f2e-fc62-45ad-824c-d167332be0fa service nova] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:42.248587 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:42.249186 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:42.249468 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:42.249736 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:42.259041 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:42.260742 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0122c6-edfe-47da-9e8b-48c8e580c98b service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:42.269594 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 823/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:51.552407 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=9 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:52.265943 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=18 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:09.107287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:09.108956 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:09.195769 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abc4be-a004-49b0-b7c5-e5bf40eb1ddd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:09.201282 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:09.201913 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:09.202222 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:09.202515 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:09.204960 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:09.217687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:09.220290 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:09.231072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 819/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:11.966349 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b72e-b994-4405-b10e-2520b732998c None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:11.966810 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b72e-b994-4405-b10e-2520b732998c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:11.966916 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b72e-b994-4405-b10e-2520b732998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:11.996797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-a011b72e-b994-4405-b10e-2520b732998c None None] MFA Rules not processed for user `550e5809b04c434daf6144e4b6cc3517`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:11.997982 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a011b72e-b994-4405-b10e-2520b732998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:12.017884 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 824/1643] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:12.054786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:12.065864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757babbe-4b5c-408a-8279-03f74a4e3b67 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:12.070886 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7865ffcaff4e8e8bdd7ceac7b27c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:12.071745 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:12.072054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:12.072348 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:12.080332 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:12.081899 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3424e36-b4bd-4fab-8f22-85f4e3080763 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:12.089786 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 820/1644] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 12:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:25:12.456942 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b72e-b994-4405-b10e-2520b732998c None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:12.458629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-a011b72e-b994-4405-b10e-2520b732998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:12.492728 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b72e-b994-4405-b10e-2520b732998c None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:12.496423 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:12.497021 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:12.497303 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:12.497571 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:12.568213 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:12.569641 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b49a-ceb3-45c6-ab1a-c92d8bcbae17 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:12.589108 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 825/1645] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:16.098767 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c7e8-cab5-4826-9b42-213c8bc858b9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:16.099292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c7e8-cab5-4826-9b42-213c8bc858b9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:16.099292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c7e8-cab5-4826-9b42-213c8bc858b9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:16.100872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 821/1646] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:16.111756 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96ad3-e2a9-4271-858e-266ac5b05148 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:16.112318 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96ad3-e2a9-4271-858e-266ac5b05148 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:16.112424 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96ad3-e2a9-4271-858e-266ac5b05148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:16.174820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-eed96ad3-e2a9-4271-858e-266ac5b05148 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:16.176484 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-eed96ad3-e2a9-4271-858e-266ac5b05148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:16.194640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 826/1647] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:25:16.213948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7c7e8-cab5-4826-9b42-213c8bc858b9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:16.230068 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7c7e8-cab5-4826-9b42-213c8bc858b9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:16.236236 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:16.236941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:16.237247 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:16.237522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:16.246279 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:16.247858 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e5e74-dfb8-40d7-a769-1685cfd26721 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:16.258402 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 822/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:19.621556 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bda5a-8ec8-4e9b-ada0-caf7a08b647c None None] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:19.622168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bda5a-8ec8-4e9b-ada0-caf7a08b647c None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:19.622168 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bda5a-8ec8-4e9b-ada0-caf7a08b647c None None] PATH_INFO: `/` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:19.623486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 827/1649] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:19.654902 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:19.656158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:19.656158 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:19.678871 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:19.682765 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:19.693137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 823/1650] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:19.694760 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bda5a-8ec8-4e9b-ada0-caf7a08b647c None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:19.709697 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bda5a-8ec8-4e9b-ada0-caf7a08b647c None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:19.712325 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:19.714504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:19.715146 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:19.715429 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:19.715764 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] PATH_INFO: `/v3/users/07253b08109e41538e37039fd8399148` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:19.716934 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07253b08109e41538e37039fd8399148)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:19.718602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: WARNING py.warnings [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:25:19.718602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: warnings.warn(msg) Sep 13 12:25:19.718602 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: Sep 13 12:25:19.719808 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:19.723712 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add31188-b6a9-4efe-9488-42510c823d2a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:19.728797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:19.729417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:19.729690 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:19.729957 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:19.738864 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:19.740577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:19.751390 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 824/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:25:19.813713 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07253b08109e41538e37039fd8399148'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:19.822988 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07253b08109e41538e37039fd8399148'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:19.823774 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07253b08109e41538e37039fd8399148'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:19.824520 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07253b08109e41538e37039fd8399148'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:19.835014 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:19.838101 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07253b08109e41538e37039fd8399148'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:19.865532 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 828/1652] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 12:25:19 2022] DELETE /identity/v3/users/07253b08109e41538e37039fd8399148 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:20.038770 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.051517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de817c79-6eb0-41b8-9165-5f82ea9f42be service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.116270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.116900 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.117567 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.117643 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] PATH_INFO: `/v3/projects/c50d298db1d041fabe16a94682d9392b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.118750 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50d298db1d041fabe16a94682d9392b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.119771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:25:20.119771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Sep 13 12:25:20.119771 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: Sep 13 12:25:20.121185 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.179065 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:20.197467 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50d298db1d041fabe16a94682d9392b', 'request_id': 'req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.205564 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50d298db1d041fabe16a94682d9392b', 'request_id': 'req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.219874 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50d298db1d041fabe16a94682d9392b', 'request_id': 'req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.249047 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] The token cache is being invalidate because project c50d298db1d041fabe16a94682d9392b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:25:20.249335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.250011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.251820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 825/1653] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/projects/c50d298db1d041fabe16a94682d9392b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:20.256026 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.257470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:20.270470 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b18f-42f6-484a-b48a-34f7a6a29af4 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.329887 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.330519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.330795 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.331067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] PATH_INFO: `/v3/users/d69843a560134787b447d8a91606cfce` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.332205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69843a560134787b447d8a91606cfce)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.334106 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.378393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69843a560134787b447d8a91606cfce'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.385524 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69843a560134787b447d8a91606cfce'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.386174 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69843a560134787b447d8a91606cfce'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.386833 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69843a560134787b447d8a91606cfce'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.394305 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-487cde09-c4f3-4862-837c-47ace3575d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69843a560134787b447d8a91606cfce'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.411504 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 829/1654] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/users/d69843a560134787b447d8a91606cfce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:20.597335 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.598878 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:20.614729 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf271d-9816-43c5-8db6-5e0a20a0bf8a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.691089 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.692137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.692137 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.692333 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] PATH_INFO: `/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.693430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c20c3e0f934e6199e3a1f72327eedf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.695324 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.746159 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c20c3e0f934e6199e3a1f72327eedf', 'request_id': 'req-978c0237-3353-4675-bdd4-25309cb6035b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.752565 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c20c3e0f934e6199e3a1f72327eedf', 'request_id': 'req-978c0237-3353-4675-bdd4-25309cb6035b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.759167 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c20c3e0f934e6199e3a1f72327eedf', 'request_id': 'req-978c0237-3353-4675-bdd4-25309cb6035b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.774265 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] The token cache is being invalidate because project d2c20c3e0f934e6199e3a1f72327eedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:25:20.774569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.775209 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.776801 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 826/1655] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/projects/d2c20c3e0f934e6199e3a1f72327eedf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:30.408100 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=61,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:30.770838 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:32.647922 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:32.648551 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:32.648701 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:32.679391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] MFA Rules not processed for user `457fd373adc2416086db90bb61de9429`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:32.681576 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:32.750851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 830/1656] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:33.115940 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:33.117417 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:33.190045 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c0237-3353-4675-bdd4-25309cb6035b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:33.194673 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:33.195393 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:33.195743 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:33.196143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:33.198270 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:33.210541 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:33.211996 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:33.220924 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 827/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:42.743845 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=25 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:43.216647 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=26 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:51.869166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:51.879054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aacb3-cdc0-4fe7-a6ca-1618d644157f None None] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:51.882640 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:51.883234 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:51.883507 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:51.883772 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:51.885519 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:51.948157 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:51.949577 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:51.958872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 831/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:01.954629 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=30 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:27:32.477893 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:32.487346 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c489-d2cb-4119-8b76-28714c14fa76 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:32.491245 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:32.491866 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:32.492180 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:32.492451 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:32.494509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:32.505173 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:32.506631 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:32.517730 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 828/1659] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:42.512352 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:27:52.574676 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:52.583518 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3915-7bfd-4951-a5a9-0200f3847c62 service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:52.587202 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:52.587807 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:52.588111 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:52.588382 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:52.590115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:52.626552 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:52.628364 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:52.649616 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 832/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:53.599191 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:53.601326 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:53.718323 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe935-7efc-4a5f-a2a2-887e7bdbe518 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:53.724380 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056e6c0714cf4827a3b118d0bddfb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:53.725076 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:53.725354 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:53.725716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:53.727777 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:53.748785 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:53.751081 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:53.767522 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 829/1661] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:53.835225 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:53.845135 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f41a-25f1-46cf-a2e3-455c66f41e2c service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:53.849316 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:53.850122 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:53.850408 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:53.850679 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:53.855012 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:53.877430 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:53.879040 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:53.892477 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 833/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:55.103709 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:55.118002 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2b01-935d-4be8-ad44-f55e36fc851b service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:55.122322 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:55.122941 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:55.123237 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:55.123486 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:55.125889 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:55.148670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:55.150149 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:55.163255 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 830/1663] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:28:03.885896 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=25 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:05.157115 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=49 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:06.424805 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:06.433358 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96786b76-ebf4-459d-94b4-ae198b68199c service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:06.437054 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003563bd8444eeea77159305220aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:06.437638 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:06.437919 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:06.438175 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:06.439828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:06.504569 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:06.505987 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:06.515869 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 834/1664] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:28:12.968851 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:12.970321 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:12.985330 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1510f86-d04b-42a8-b8e4-8306fd01d3f8 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:12.992828 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:12.993905 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:12.994391 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:12.994872 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] PATH_INFO: `/v3/users/457fd373adc2416086db90bb61de9429` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:12.996901 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457fd373adc2416086db90bb61de9429)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:13.000740 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:13.058797 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457fd373adc2416086db90bb61de9429'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.059559 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457fd373adc2416086db90bb61de9429'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.060189 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457fd373adc2416086db90bb61de9429'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.069091 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457fd373adc2416086db90bb61de9429'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.081962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457fd373adc2416086db90bb61de9429'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.100361 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 831/1665] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 12:28:12 2022] DELETE /identity/v3/users/457fd373adc2416086db90bb61de9429 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:13.333023 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:13.344681 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08e77-d348-4d6e-aff8-967942aa40e6 service neutron] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:13.408953 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:13.409592 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:13.409974 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:13.410314 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] PATH_INFO: `/v3/projects/5ae4a2e63f6941a6ab0046caf8687879` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:13.411659 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae4a2e63f6941a6ab0046caf8687879)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:13.413835 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:13.467215 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae4a2e63f6941a6ab0046caf8687879', 'request_id': 'req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.474287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae4a2e63f6941a6ab0046caf8687879', 'request_id': 'req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.482670 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae4a2e63f6941a6ab0046caf8687879', 'request_id': 'req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.494124 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] The token cache is being invalidate because project 5ae4a2e63f6941a6ab0046caf8687879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:28:13.494509 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.495200 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.496806 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 835/1666] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 12:28:13 2022] DELETE /identity/v3/projects/5ae4a2e63f6941a6ab0046caf8687879 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:13.500908 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:13.502397 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:13.516724 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218240a-6084-4d30-bb4d-3a9bbed7aa96 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:13.576387 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:13.577007 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:13.577287 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:13.577570 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] PATH_INFO: `/v3/users/8971b1e4bcf147139e8b671795e66843` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:13.591389 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8971b1e4bcf147139e8b671795e66843)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:13.593399 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:13.645136 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8971b1e4bcf147139e8b671795e66843'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.645855 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8971b1e4bcf147139e8b671795e66843'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.646973 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8971b1e4bcf147139e8b671795e66843'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.654844 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8971b1e4bcf147139e8b671795e66843'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.660529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:13.670642 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-22002ac4-0eb2-4ede-af20-f61b0e2017b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8971b1e4bcf147139e8b671795e66843'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:13.685475 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 832/1667] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 12:28:13 2022] DELETE /identity/v3/users/8971b1e4bcf147139e8b671795e66843 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:13.868684 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Authenticating user token {{(pid=81576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:13.870163 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:13.884687 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c71ed-d9cb-4b64-9585-bc92cd3458b4 admin admin] Validating token access rules against request {{(pid=81576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:13.915249 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:13.981632 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25e6c04dcaa6467c806fd0a095469485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5edf9a0e494edcae6ef0e92c3e80ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:13.982281 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:13.982558 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:13.982829 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] PATH_INFO: `/v3/projects/623920c9e7df4df481523a1c80c6d43a` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:13.995067 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623920c9e7df4df481523a1c80c6d43a)` {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:13.997072 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] RBAC: Authorization granted {{(pid=81576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:14.053011 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623920c9e7df4df481523a1c80c6d43a', 'request_id': 'req-e703c53b-61e5-444e-96bb-789cecec4c05'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:14.061292 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623920c9e7df4df481523a1c80c6d43a', 'request_id': 'req-e703c53b-61e5-444e-96bb-789cecec4c05'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:14.070881 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623920c9e7df4df481523a1c80c6d43a', 'request_id': 'req-e703c53b-61e5-444e-96bb-789cecec4c05'} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:14.084820 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] The token cache is being invalidate because project 623920c9e7df4df481523a1c80c6d43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:28:14.085112 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:14.085791 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.notifications [None req-e703c53b-61e5-444e-96bb-789cecec4c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:14.087396 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 836/1668] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 12:28:13 2022] DELETE /identity/v3/projects/623920c9e7df4df481523a1c80c6d43a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:23.681166 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:24.081143 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:33.021063 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758da5ae-79ad-47dc-ae52-21d86af56851 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:33.021517 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758da5ae-79ad-47dc-ae52-21d86af56851 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:33.021624 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758da5ae-79ad-47dc-ae52-21d86af56851 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:33.022972 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 833/1669] 10.222.0.43 () {54 vars in 961 bytes} [Tue Sep 13 12:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:33.027948 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92142b-0638-4d2f-a185-11e87542f2f9 None None] REQUEST_METHOD: `POST` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:33.028433 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92142b-0638-4d2f-a185-11e87542f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:33.028529 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92142b-0638-4d2f-a185-11e87542f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:33.048762 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.auth.core [None req-3f92142b-0638-4d2f-a185-11e87542f2f9 None None] MFA Rules not processed for user `7e4b73d8301942e09c8430d3529ab769`. Rule list: `[]` (Enabled: `True`). {{(pid=81576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:33.049962 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG keystone.common.fernet_utils [None req-3f92142b-0638-4d2f-a185-11e87542f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:33.118706 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: [pid: 81576|app: 0|req: 837/1670] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Sep 13 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:33.126625 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758da5ae-79ad-47dc-ae52-21d86af56851 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:33.140096 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758da5ae-79ad-47dc-ae52-21d86af56851 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:33.145463 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4b73d8301942e09c8430d3529ab769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f8d87589c9b4f61b638b32f5427ac61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:33.146056 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:33.146329 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:33.146601 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:33.148327 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:33.161118 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:33.162716 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2667-6f8d-4be9-83c0-9a3b60e1e061 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:33.173727 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 834/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:43.108121 dv-osbrick-857347-1-iscsi devstack@keystone.service[81576]: DEBUG dbcounter [-] [81576] Writing DB stats keystone:SELECT=29 {{(pid=81576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:43.169205 dv-osbrick-857347-1-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}